[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:12:59 dist-test-slave-gw5c krb5kdc[715](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:12:59 dist-test-slave-gw5c krb5kdc[715](info): set up 2 sockets
Aug 12 06:12:59 dist-test-slave-gw5c krb5kdc[715](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 06:13:00.312631 707 mini_kdc.cc:121] Time spent starting KDC: real 1.344s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:00 dist-test-slave-gw5c krb5kdc[715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:13:00.454700 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:38135
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:38135
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:00.554039 731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:00.554332 731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:00.554378 731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:00.555873 731 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:00.555943 731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:00.555975 731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:00.556005 731 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:00.556038 731 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:00.557972 731 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:38135
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:38135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:00.558308 731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:00.558568 731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:00.564019 740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:00.564019 736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:00.564143 737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:00.564213 731 server_base.cc:1034] running on GCE node
I20260812 06:13:00.564509 731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:00.564837 731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:00.566033 731 hybrid_clock.cc:648] HybridClock initialized: now 1786515180566010 us; error 75 us; skew 500 ppm
Aug 12 06:13:00 dist-test-slave-gw5c krb5kdc[715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515180, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:00.569504 731 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:13:00.570027 731 webserver.cc:460] Webserver started at http://127.0.176.254:42581/ using document root <none> and password file <none>
I20260812 06:13:00.570303 731 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:00.570377 731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:00.570578 731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:00.572137 731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "283920e0a37245a68116f833939fcefe"
format_stamp: "Formatted at 2026-08-12 06:13:00 on dist-test-slave-gw5c"
server_key: "5b134fd993c92cd25a99c8f09a35e192"
server_key_iv: "3226c8cc5d0d75adaaf5aa4d7b9cdd06"
server_key_version: "encryptionkey@0"
I20260812 06:13:00.572638 731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "283920e0a37245a68116f833939fcefe"
format_stamp: "Formatted at 2026-08-12 06:13:00 on dist-test-slave-gw5c"
server_key: "5b134fd993c92cd25a99c8f09a35e192"
server_key_iv: "3226c8cc5d0d75adaaf5aa4d7b9cdd06"
server_key_version: "encryptionkey@0"
I20260812 06:13:00.574203 731 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:13:00.575155 756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:00.575373 731 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:00.575518 731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "283920e0a37245a68116f833939fcefe"
format_stamp: "Formatted at 2026-08-12 06:13:00 on dist-test-slave-gw5c"
server_key: "5b134fd993c92cd25a99c8f09a35e192"
server_key_iv: "3226c8cc5d0d75adaaf5aa4d7b9cdd06"
server_key_version: "encryptionkey@0"
I20260812 06:13:00.575608 731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:00.590109 731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:00.592576 731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:00.592743 731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:00.597541 731 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:38135
I20260812 06:13:00.597577 826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:38135 every 8 connection(s)
I20260812 06:13:00.597971 731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:00.599151 828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:00.601203 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 731
I20260812 06:13:00.601332 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:00.602140 707 external_mini_cluster.cc:1428] Setting key 713965f3b9e306f870b3e2dab01fcbb8
I20260812 06:13:00.602254 828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe: Bootstrap starting.
I20260812 06:13:00.603011 828 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:00.603384 828 log.cc:824] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:00.604700 828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe: No bootstrap required, opened a new log
I20260812 06:13:00.607064 828 raft_consensus.cc:348] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283920e0a37245a68116f833939fcefe" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38135 } }
I20260812 06:13:00.607223 828 raft_consensus.cc:374] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:00.607246 828 raft_consensus.cc:729] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283920e0a37245a68116f833939fcefe, State: Initialized, Role: FOLLOWER
I20260812 06:13:00.607435 828 consensus_queue.cc:260] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283920e0a37245a68116f833939fcefe" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38135 } }
I20260812 06:13:00.607542 828 raft_consensus.cc:388] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:00.607581 828 raft_consensus.cc:482] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:00.607637 828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:00.608922 828 raft_consensus.cc:504] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283920e0a37245a68116f833939fcefe" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38135 } }
I20260812 06:13:00.609066 828 leader_election.cc:302] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 283920e0a37245a68116f833939fcefe; no voters:
I20260812 06:13:00.609294 828 leader_election.cc:288] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:00.609380 834 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:00.609632 828 sys_catalog.cc:564] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:00.609701 834 raft_consensus.cc:686] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [term 1 LEADER]: Becoming Leader. State: Replica: 283920e0a37245a68116f833939fcefe, State: Running, Role: LEADER
I20260812 06:13:00.609872 834 consensus_queue.cc:237] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283920e0a37245a68116f833939fcefe" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38135 } }
I20260812 06:13:00.610335 838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "283920e0a37245a68116f833939fcefe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283920e0a37245a68116f833939fcefe" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38135 } } }
I20260812 06:13:00.610425 838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:00.610630 840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 283920e0a37245a68116f833939fcefe. Latest consensus state: current_term: 1 leader_uuid: "283920e0a37245a68116f833939fcefe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "283920e0a37245a68116f833939fcefe" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38135 } } }
I20260812 06:13:00.610690 840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:00.610678 853 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:00.611320 853 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:00.613198 853 catalog_manager.cc:1347] Generated new cluster ID: 8a272c29812d48f2b45302c7374b8171
I20260812 06:13:00.613260 853 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:13:00 dist-test-slave-gw5c krb5kdc[715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:00.621454 831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:00.603284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49164 (local address 127.0.176.254:38135)
0812 06:13:00.603550 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:00.603560 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:00.603877 (+ 317us) server_negotiation.cc:407] Connection header received
0812 06:13:00.607057 (+ 3180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:00.607067 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:00.607143 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:00.607350 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:00.609877 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:00.611439 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:00.612993 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:00.613552 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:00.613686 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:00.617311 (+ 3625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:00.617316 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:00.617316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:00.617327 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:00.619172 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:00.619769 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:00.619772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:00.619772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:00.619881 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:00.620165 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:00.620165 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:00.620166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:00.620433 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:00.620638 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:00.620914 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 06:13:00.621070 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":119,"threads_started":1}
I20260812 06:13:00.629637 853 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:00.630232 853 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:00.635605 853 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 283920e0a37245a68116f833939fcefe: Generated new TSK 0
I20260812 06:13:00.635834 853 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:13:00.664772 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:38135
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:00.773613 876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:00.773896 876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:00.773944 876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:00.775214 876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:00.775290 876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:00.775341 876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:00.777002 876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:38135
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:00.777318 876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:00.777576 876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:00.783181 886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:00.783213 882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:00.783181 883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:00.783495 876 server_base.cc:1034] running on GCE node
I20260812 06:13:00.783849 876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:00.784173 876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:00.785356 876 hybrid_clock.cc:648] HybridClock initialized: now 1786515180785306 us; error 65 us; skew 500 ppm
Aug 12 06:13:00 dist-test-slave-gw5c krb5kdc[715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515180, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:00.788146 876 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:13:00.788641 876 webserver.cc:460] Webserver started at http://127.0.176.193:35383/ using document root <none> and password file <none>
I20260812 06:13:00.788884 876 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:00.788937 876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:00.789098 876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:00.790246 876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "2088ad9a06ce432fb94456add43be65e"
format_stamp: "Formatted at 2026-08-12 06:13:00 on dist-test-slave-gw5c"
server_key: "e1138ff06dc5fe2a953c197c0b521785"
server_key_iv: "f6d244ee1b607dbb3773d81e5e209880"
server_key_version: "encryptionkey@0"
I20260812 06:13:00.790637 876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "2088ad9a06ce432fb94456add43be65e"
format_stamp: "Formatted at 2026-08-12 06:13:00 on dist-test-slave-gw5c"
server_key: "e1138ff06dc5fe2a953c197c0b521785"
server_key_iv: "f6d244ee1b607dbb3773d81e5e209880"
server_key_version: "encryptionkey@0"
I20260812 06:13:00.792255 876 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:00.793108 898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:00.793309 876 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:00.793409 876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "2088ad9a06ce432fb94456add43be65e"
format_stamp: "Formatted at 2026-08-12 06:13:00 on dist-test-slave-gw5c"
server_key: "e1138ff06dc5fe2a953c197c0b521785"
server_key_iv: "f6d244ee1b607dbb3773d81e5e209880"
server_key_version: "encryptionkey@0"
I20260812 06:13:00.793483 876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:00.817881 876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:00.820568 876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:00.820699 876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:00.820935 876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:00.821291 876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:00.821331 876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:00.821362 876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:00.821374 876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:00.827828 876 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:38511
I20260812 06:13:00.827879 1074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:38511 every 8 connection(s)
I20260812 06:13:00.828243 876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:00.831852 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 876
I20260812 06:13:00.831983 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:00.832142 707 external_mini_cluster.cc:1428] Setting key cb39a5da47efd400bf16335621783daf
Aug 12 06:13:00 dist-test-slave-gw5c krb5kdc[715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515180, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:00.839921 831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:00.829137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:41055 (local address 127.0.176.254:38135)
0812 06:13:00.829242 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:00.829245 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:00.829459 (+ 214us) server_negotiation.cc:407] Connection header received
0812 06:13:00.830656 (+ 1197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:00.830657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:00.830676 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:00.830732 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:00.831488 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:00.832057 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:00.833263 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:00.833503 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:00.833595 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:00.836499 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:00.836502 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:00.836502 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:00.836512 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:00.838255 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:00.838737 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:00.838738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:00.838738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:00.838802 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:00.839097 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:00.839098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:00.839099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:00.839227 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:00.839301 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:00.839710 (+ 409us) server_negotiation.cc:299] Negotiation successful
0812 06:13:00.839823 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 06:13:00.840142 1078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:00.829083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:38135 (local address 127.0.176.193:41055)
0812 06:13:00.829297 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:00.829352 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:00.830491 (+ 1139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:00.830808 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:00.830812 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:00.831116 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:00.831328 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:00.831332 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:00.832144 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:00.832145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:00.833163 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:00.833167 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:00.833614 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:00.833615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:00.833754 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:00.834384 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:00.834394 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:00.836359 (+ 1965us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:00.838369 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:00.838380 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:00.838382 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:00.838642 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:00.838876 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:00.838877 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:00.838877 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:00.839018 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:00.839303 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:00.839311 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:00.839559 (+ 248us) client_negotiation.cc:769] Sending connection context
0812 06:13:00.839674 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 06:13:00.839862 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":107,"threads_started":1}
I20260812 06:13:00.840716 1075 heartbeater.cc:347] Connected to a master server at 127.0.176.254:38135
I20260812 06:13:00.840844 1075 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:00.841090 1075 heartbeater.cc:511] Master 127.0.176.254:38135 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
I20260812 06:13:00.841701 778 ts_manager.cc:194] Registered new tserver with Master: 2088ad9a06ce432fb94456add43be65e (127.0.176.193:38511)
I20260812 06:13:00.842343 778 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:41055
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:13:00.863068 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:38135
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:00.950984 1081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:00.951211 1081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:00.951238 1081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:00.952401 1081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:00.952442 1081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:00.952469 1081 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:00.953912 1081 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:38135
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:00.954130 1081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:00.954329 1081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:00.959375 1090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:00.959367 1093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:00.959369 1091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:00.959617 1081 server_base.cc:1034] running on GCE node
I20260812 06:13:00.959955 1081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:00.960219 1081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:00.961369 1081 hybrid_clock.cc:648] HybridClock initialized: now 1786515180961356 us; error 31 us; skew 500 ppm
Aug 12 06:13:00 dist-test-slave-gw5c krb5kdc[715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515180, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:00.964025 1081 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:13:00.964484 1081 webserver.cc:460] Webserver started at http://127.0.176.194:34379/ using document root <none> and password file <none>
I20260812 06:13:00.964740 1081 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:00.964812 1081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:00.964972 1081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:00.966071 1081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "12caa1947fd44f149a9a9130fc285f55"
format_stamp: "Formatted at 2026-08-12 06:13:00 on dist-test-slave-gw5c"
server_key: "23b6ec2fa0c1f24116548e7646745295"
server_key_iv: "59a45fb99df72af9daef705d49693ad9"
server_key_version: "encryptionkey@0"
I20260812 06:13:00.966444 1081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "12caa1947fd44f149a9a9130fc285f55"
format_stamp: "Formatted at 2026-08-12 06:13:00 on dist-test-slave-gw5c"
server_key: "23b6ec2fa0c1f24116548e7646745295"
server_key_iv: "59a45fb99df72af9daef705d49693ad9"
server_key_version: "encryptionkey@0"
I20260812 06:13:00.967986 1081 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:00.968854 1105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:00.969318 1081 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:00.969566 1081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "12caa1947fd44f149a9a9130fc285f55"
format_stamp: "Formatted at 2026-08-12 06:13:00 on dist-test-slave-gw5c"
server_key: "23b6ec2fa0c1f24116548e7646745295"
server_key_iv: "59a45fb99df72af9daef705d49693ad9"
server_key_version: "encryptionkey@0"
I20260812 06:13:00.969659 1081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:00.979208 1081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:00.981439 1081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:00.981741 1081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:00.982061 1081 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:00.982427 1081 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:00.982487 1081 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:00.982532 1081 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:00.982556 1081 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:00.988899 1081 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:35521
I20260812 06:13:00.988950 1264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:35521 every 8 connection(s)
I20260812 06:13:00.989302 1081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:13:00.990201 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 1081
I20260812 06:13:00.990329 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:13:00.990515 707 external_mini_cluster.cc:1428] Setting key 099cc6058aebd86b3c7ea45c6c5e78bf
Aug 12 06:13:00 dist-test-slave-gw5c krb5kdc[715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515180, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
I20260812 06:13:01.000331 831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:00.990047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:51305 (local address 127.0.176.254:38135)
0812 06:13:00.990134 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:00.990136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:00.990347 (+ 211us) server_negotiation.cc:407] Connection header received
0812 06:13:00.991028 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:00.991029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:00.991041 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:00.991123 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:00.992295 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:00.992803 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:00.993842 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:00.994052 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:00.994133 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:00.996953 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:00.996956 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:00.996956 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:00.996966 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:00.998494 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:00.999014 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:00.999015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:00.999016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:00.999084 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:00.999530 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:00.999531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:00.999532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:00.999678 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:00.999766 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:01.000132 (+ 366us) server_negotiation.cc:299] Negotiation successful
0812 06:13:01.000232 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 06:13:01.000488 1270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:00.990017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:38135 (local address 127.0.176.194:51305)
0812 06:13:00.990222 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:00.990266 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:00.990936 (+ 670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:00.991226 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:00.991231 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:00.991960 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:00.992172 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:00.992177 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:00.992909 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:00.992909 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:00.993732 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:00.993734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:00.994141 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:00.994142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:00.994304 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:00.994912 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:00.994923 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:00.996838 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:00.998611 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:00.998620 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:00.998623 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:00.998875 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:00.999156 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:00.999157 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:00.999157 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:00.999457 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:00.999754 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:00.999762 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:00.999927 (+ 165us) client_negotiation.cc:769] Sending connection context
0812 06:13:01.000038 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 06:13:01.000236 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":126,"threads_started":1}
I20260812 06:13:01.001098 1265 heartbeater.cc:347] Connected to a master server at 127.0.176.254:38135
I20260812 06:13:01.001232 1265 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:01.001442 1265 heartbeater.cc:511] Master 127.0.176.254:38135 requested a full tablet report, sending...
I20260812 06:13:01.001843 778 ts_manager.cc:194] Registered new tserver with Master: 12caa1947fd44f149a9a9130fc285f55 (127.0.176.194:35521)
I20260812 06:13:01.002255 778 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:51305
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:13:01.018741 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:38135
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:01.104476 1275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:01.104708 1275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:01.104735 1275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:01.105979 1275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:01.106029 1275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:01.106058 1275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:01.107538 1275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:38135
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:01.107758 1275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:01.107952 1275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:01.113533 1287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:01.113714 1275 server_base.cc:1034] running on GCE node
W20260812 06:13:01.113790 1284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:01.113554 1285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:01.114051 1275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:01.114348 1275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:01.115454 1275 hybrid_clock.cc:648] HybridClock initialized: now 1786515181115446 us; error 36 us; skew 500 ppm
Aug 12 06:13:01 dist-test-slave-gw5c krb5kdc[715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515181, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:01.118289 1275 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:13:01.118714 1275 webserver.cc:460] Webserver started at http://127.0.176.195:43791/ using document root <none> and password file <none>
I20260812 06:13:01.118908 1275 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:01.118949 1275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:01.119058 1275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:01.120162 1275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "e88f124edfab480b87ee3a17aa3da1ad"
format_stamp: "Formatted at 2026-08-12 06:13:01 on dist-test-slave-gw5c"
server_key: "b9b9cc0ed3c4ba9b3b5987330754a482"
server_key_iv: "706b85b02d6bcc6fa1f6b37b0bb3c00b"
server_key_version: "encryptionkey@0"
I20260812 06:13:01.120489 1275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "e88f124edfab480b87ee3a17aa3da1ad"
format_stamp: "Formatted at 2026-08-12 06:13:01 on dist-test-slave-gw5c"
server_key: "b9b9cc0ed3c4ba9b3b5987330754a482"
server_key_iv: "706b85b02d6bcc6fa1f6b37b0bb3c00b"
server_key_version: "encryptionkey@0"
I20260812 06:13:01.121887 1275 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:01.122678 1295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:01.122869 1275 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:01.122979 1275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "e88f124edfab480b87ee3a17aa3da1ad"
format_stamp: "Formatted at 2026-08-12 06:13:01 on dist-test-slave-gw5c"
server_key: "b9b9cc0ed3c4ba9b3b5987330754a482"
server_key_iv: "706b85b02d6bcc6fa1f6b37b0bb3c00b"
server_key_version: "encryptionkey@0"
I20260812 06:13:01.123059 1275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:01.137537 1275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:01.140142 1275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:01.140323 1275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:01.140601 1275 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:01.140945 1275 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:01.141002 1275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:01.141048 1275 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:01.141081 1275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:01.147533 1275 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:37827
I20260812 06:13:01.147580 1466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:37827 every 8 connection(s)
I20260812 06:13:01.147921 1275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:13:01 dist-test-slave-gw5c krb5kdc[715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515181, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:01.154922 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 1275
I20260812 06:13:01.155005 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:13:01.155200 707 external_mini_cluster.cc:1428] Setting key 9393e624f9ee90b11173ad192d7e8ea8
I20260812 06:13:01.157899 831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:01.148763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:54085 (local address 127.0.176.254:38135)
0812 06:13:01.148836 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:01.148838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:01.149078 (+ 240us) server_negotiation.cc:407] Connection header received
0812 06:13:01.149573 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:01.149574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:01.149584 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:01.149651 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:01.150703 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:01.151209 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:01.152301 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:01.152497 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:01.152557 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:01.154845 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:01.154847 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:01.154847 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:01.154856 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:01.156562 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:01.156964 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:01.156965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:01.156965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:01.157021 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:01.157244 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:01.157245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:01.157245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:01.157353 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:01.157407 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:01.157750 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 06:13:01.157831 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 06:13:01.158074 1469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:01.148733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:38135 (local address 127.0.176.195:54085)
0812 06:13:01.148929 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:01.148981 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:01.149485 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:01.149729 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:01.149733 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:01.150349 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:01.150563 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:01.150568 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:01.151302 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:01.151303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:01.152210 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:01.152212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:01.152580 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:01.152580 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:01.152684 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:01.153193 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:01.153203 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:01.154727 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:01.156631 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:01.156637 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:01.156639 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:01.156887 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:01.157079 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:01.157080 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:01.157080 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:01.157179 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:01.157461 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:01.157469 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:01.157607 (+ 138us) client_negotiation.cc:769] Sending connection context
0812 06:13:01.157709 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 06:13:01.157847 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":118,"threads_started":1}
I20260812 06:13:01.158556 1467 heartbeater.cc:347] Connected to a master server at 127.0.176.254:38135
I20260812 06:13:01.158671 1467 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:01.158859 1467 heartbeater.cc:511] Master 127.0.176.254:38135 requested a full tablet report, sending...
I20260812 06:13:01.159281 778 ts_manager.cc:194] Registered new tserver with Master: e88f124edfab480b87ee3a17aa3da1ad (127.0.176.195:37827)
I20260812 06:13:01.159677 778 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:54085
I20260812 06:13:01.168210 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:13:01 dist-test-slave-gw5c krb5kdc[715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515181, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:13:01 dist-test-slave-gw5c krb5kdc[715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515181, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.176.193@KRBTEST.COM
I20260812 06:13:01.195073 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:01.186427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54536 (local address 127.0.176.193:38511)
0812 06:13:01.186625 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:01.186630 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:01.186642 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:13:01.186670 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:01.186672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:01.186687 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:01.186761 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:01.187318 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:01.188139 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:01.188939 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:01.189337 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:01.189400 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:01.191919 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:01.191931 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:01.191931 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:01.191940 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:01.193718 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:01.194124 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:01.194127 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:01.194127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:01.194200 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:01.194442 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:01.194444 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:01.194444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:01.194643 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:01.194766 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:01.194847 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 06:13:01.194921 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":110,"threads_started":1}
W20260812 06:13:01.195667 940 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54536
Aug 12 06:13:01 dist-test-slave-gw5c krb5kdc[715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:13:01 dist-test-slave-gw5c krb5kdc[715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.193@KRBTEST.COM
I20260812 06:13:01.221127 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:01.213714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54540 (local address 127.0.176.193:38511)
0812 06:13:01.213773 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:01.213775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:01.213843 (+ 68us) server_negotiation.cc:407] Connection header received
0812 06:13:01.213901 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:01.213901 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:01.213915 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:01.213966 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:01.214622 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:01.215135 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:01.216011 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:01.216231 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:01.216305 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:01.218755 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:01.218757 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:01.218757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:01.218769 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:01.220181 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:01.220502 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:01.220503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:01.220503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:01.220555 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:01.220721 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:01.220721 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:01.220722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:01.220817 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:01.220917 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:01.220990 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 06:13:01.221060 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:13:01.221784 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 876
I20260812 06:13:01.234937 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 1081
I20260812 06:13:01.262005 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 1275
I20260812 06:13:01.277962 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 731
2026-08-12T06:13:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2346 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:13:01 dist-test-slave-gw5c krb5kdc[1488](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:13:01 dist-test-slave-gw5c krb5kdc[1488](info): set up 2 sockets
Aug 12 06:13:01 dist-test-slave-gw5c krb5kdc[1488](info): commencing operation
krb5kdc: starting...
W20260812 06:13:02.575738 707 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:02 dist-test-slave-gw5c krb5kdc[1488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:13:02.706749 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:36077
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:36077
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:02.794391 1508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:02.794638 1508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:02.794663 1508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:02.795918 1508 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:02.795975 1508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:02.795991 1508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:02.796032 1508 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:02.796065 1508 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:02.797684 1508 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:36077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:36077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:02.798003 1508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:02.798269 1508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:02.803519 1523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:02.803500 1519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:02.803504 1520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:02.803884 1508 server_base.cc:1034] running on GCE node
I20260812 06:13:02.804181 1508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:02.804523 1508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:02.805750 1508 hybrid_clock.cc:648] HybridClock initialized: now 1786515182805722 us; error 41 us; skew 500 ppm
Aug 12 06:13:02 dist-test-slave-gw5c krb5kdc[1488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515182, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:02.808975 1508 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:13:02.809588 1508 webserver.cc:460] Webserver started at http://127.0.176.254:45489/ using document root <none> and password file <none>
I20260812 06:13:02.809873 1508 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:02.809929 1508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:02.810081 1508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:02.811453 1508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "f6a572a9fe8c431b87d2c1c6bafe5b5d"
format_stamp: "Formatted at 2026-08-12 06:13:02 on dist-test-slave-gw5c"
server_key: "84c62fc3303b044d6041fa9f07cc54fe"
server_key_iv: "9db3def8da9f3220dae151cf28b1f41b"
server_key_version: "encryptionkey@0"
I20260812 06:13:02.811895 1508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "f6a572a9fe8c431b87d2c1c6bafe5b5d"
format_stamp: "Formatted at 2026-08-12 06:13:02 on dist-test-slave-gw5c"
server_key: "84c62fc3303b044d6041fa9f07cc54fe"
server_key_iv: "9db3def8da9f3220dae151cf28b1f41b"
server_key_version: "encryptionkey@0"
I20260812 06:13:02.813493 1508 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:02.814386 1532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:02.814605 1508 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:02.814726 1508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "f6a572a9fe8c431b87d2c1c6bafe5b5d"
format_stamp: "Formatted at 2026-08-12 06:13:02 on dist-test-slave-gw5c"
server_key: "84c62fc3303b044d6041fa9f07cc54fe"
server_key_iv: "9db3def8da9f3220dae151cf28b1f41b"
server_key_version: "encryptionkey@0"
I20260812 06:13:02.814812 1508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:02.823949 1508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:02.826720 1508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:02.826946 1508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:02.831661 1508 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:36077
I20260812 06:13:02.831764 1625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:36077 every 8 connection(s)
I20260812 06:13:02.832145 1508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:02.833105 1626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:02.833427 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 1508
I20260812 06:13:02.833539 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:02.833720 707 external_mini_cluster.cc:1428] Setting key aeec05e91a112e674a6bd0b52de67ed4
I20260812 06:13:02.836462 1626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d: Bootstrap starting.
I20260812 06:13:02.837388 1626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:02.837728 1626 log.cc:824] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:02.838618 1626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d: No bootstrap required, opened a new log
I20260812 06:13:02.841063 1626 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6a572a9fe8c431b87d2c1c6bafe5b5d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36077 } }
I20260812 06:13:02.841269 1626 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:02.841323 1626 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6a572a9fe8c431b87d2c1c6bafe5b5d, State: Initialized, Role: FOLLOWER
I20260812 06:13:02.841485 1626 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6a572a9fe8c431b87d2c1c6bafe5b5d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36077 } }
Aug 12 06:13:02 dist-test-slave-gw5c krb5kdc[1488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:02.841571 1626 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:02.841612 1626 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:02.841671 1626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:02.842490 1626 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6a572a9fe8c431b87d2c1c6bafe5b5d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36077 } }
I20260812 06:13:02.842608 1626 leader_election.cc:302] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6a572a9fe8c431b87d2c1c6bafe5b5d; no voters:
I20260812 06:13:02.842810 1626 leader_election.cc:288] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:02.842867 1632 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:02.843052 1632 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [term 1 LEADER]: Becoming Leader. State: Replica: f6a572a9fe8c431b87d2c1c6bafe5b5d, State: Running, Role: LEADER
I20260812 06:13:02.843130 1626 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:02.843209 1632 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6a572a9fe8c431b87d2c1c6bafe5b5d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36077 } }
I20260812 06:13:02.843873 1632 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6a572a9fe8c431b87d2c1c6bafe5b5d. Latest consensus state: current_term: 1 leader_uuid: "f6a572a9fe8c431b87d2c1c6bafe5b5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6a572a9fe8c431b87d2c1c6bafe5b5d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36077 } } }
I20260812 06:13:02.844280 1636 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6a572a9fe8c431b87d2c1c6bafe5b5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6a572a9fe8c431b87d2c1c6bafe5b5d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36077 } } }
I20260812 06:13:02.844368 1632 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:02.844611 1636 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:02.844838 1645 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:02.845510 1645 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:02.847193 1630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:02.834342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59272 (local address 127.0.176.254:36077)
0812 06:13:02.834560 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:02.834571 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:02.834609 (+ 38us) server_negotiation.cc:407] Connection header received
0812 06:13:02.835142 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:02.835151 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:02.835220 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:02.835422 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:02.836112 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:02.837580 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:02.838469 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:02.839093 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:02.839217 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:02.842155 (+ 2938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:02.842160 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:02.842160 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:02.842173 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:02.844888 (+ 2715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:02.845426 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:02.845429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:02.845430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:02.845549 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:02.845809 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:02.845811 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:02.845811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:02.846151 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:02.846745 (+ 594us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:02.846831 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 06:13:02.846983 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":87,"threads_started":1}
I20260812 06:13:02.847198 1645 catalog_manager.cc:1347] Generated new cluster ID: d0967c53c1e14ac79a864d02b5d2c45a
I20260812 06:13:02.847306 1645 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:02.856889 1645 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:02.858464 1645 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:02.863464 1645 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6a572a9fe8c431b87d2c1c6bafe5b5d: Generated new TSK 0
I20260812 06:13:02.863765 1645 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:13:02.899201 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36077
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:02.999184 1660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:02.999619 1660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:02.999697 1660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:03.001929 1660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:03.002007 1660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:03.002056 1660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:03.004990 1660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36077
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:03.007194 1660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:03.007622 1660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:03.015520 1674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:03.015532 1677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:03.015532 1673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:03.015764 1660 server_base.cc:1034] running on GCE node
I20260812 06:13:03.016280 1660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:03.016563 1660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:03.017714 1660 hybrid_clock.cc:648] HybridClock initialized: now 1786515183017700 us; error 40 us; skew 500 ppm
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[1488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515183, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:03.021274 1660 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:13:03.021795 1660 webserver.cc:460] Webserver started at http://127.0.176.193:38515/ using document root <none> and password file <none>
I20260812 06:13:03.022137 1660 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:03.022261 1660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:03.022429 1660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:03.023701 1660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "f4fb553e1c0a429fa91320d085ebd96c"
format_stamp: "Formatted at 2026-08-12 06:13:03 on dist-test-slave-gw5c"
server_key: "1f2f62937eeb3977a5ed3a47ca806e89"
server_key_iv: "b3c7dab54c0886b62327b5de958302a2"
server_key_version: "encryptionkey@0"
I20260812 06:13:03.024118 1660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "f4fb553e1c0a429fa91320d085ebd96c"
format_stamp: "Formatted at 2026-08-12 06:13:03 on dist-test-slave-gw5c"
server_key: "1f2f62937eeb3977a5ed3a47ca806e89"
server_key_iv: "b3c7dab54c0886b62327b5de958302a2"
server_key_version: "encryptionkey@0"
I20260812 06:13:03.025600 1660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:03.026468 1687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:03.026769 1660 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:03.026857 1660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "f4fb553e1c0a429fa91320d085ebd96c"
format_stamp: "Formatted at 2026-08-12 06:13:03 on dist-test-slave-gw5c"
server_key: "1f2f62937eeb3977a5ed3a47ca806e89"
server_key_iv: "b3c7dab54c0886b62327b5de958302a2"
server_key_version: "encryptionkey@0"
I20260812 06:13:03.026966 1660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:03.035785 1660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:03.038300 1660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:03.038431 1660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:03.038655 1660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:03.039032 1660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:03.039072 1660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:03.039096 1660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:03.039143 1660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:03.045610 1660 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:37355
I20260812 06:13:03.045697 1871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:37355 every 8 connection(s)
I20260812 06:13:03.046052 1660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:03.048101 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 1660
I20260812 06:13:03.048207 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:03.048385 707 external_mini_cluster.cc:1428] Setting key 350548b954c1135d8fc7106de0aa44a3
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[1488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515183, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:03.058588 1630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.046891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:44795 (local address 127.0.176.254:36077)
0812 06:13:03.046976 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:03.046978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:03.047182 (+ 204us) server_negotiation.cc:407] Connection header received
0812 06:13:03.047972 (+ 790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:03.047974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:03.047989 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:03.048053 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:03.049298 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.050020 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.051157 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.051437 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.051525 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.054355 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:03.054358 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:03.054358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:03.054369 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:03.056654 (+ 2285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.057326 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.057328 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.057328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.057402 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.057724 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.057725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.057726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.057899 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:03.057981 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:03.058312 (+ 331us) server_negotiation.cc:299] Negotiation successful
0812 06:13:03.058435 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:13:03.058861 1876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.046853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36077 (local address 127.0.176.193:44795)
0812 06:13:03.047049 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:03.047095 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:03.047746 (+ 651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:03.048149 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:03.048153 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:03.048931 (+ 778us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:03.049182 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.049189 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.050127 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.050128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.051056 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.051059 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.051537 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.051539 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.051681 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.052345 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:03.052357 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:03.054221 (+ 1864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:03.056787 (+ 2566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:03.056799 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:03.056802 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:03.057220 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:03.057483 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:03.057484 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:03.057484 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:03.057642 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:03.058000 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:03.058007 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:03.058157 (+ 150us) client_negotiation.cc:769] Sending connection context
0812 06:13:03.058264 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 06:13:03.058429 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":101,"threads_started":1}
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
I20260812 06:13:03.059888 1872 heartbeater.cc:347] Connected to a master server at 127.0.176.254:36077
I20260812 06:13:03.060098 1872 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:03.060416 1872 heartbeater.cc:511] Master 127.0.176.254:36077 requested a full tablet report, sending...
I20260812 06:13:03.061482 1562 ts_manager.cc:194] Registered new tserver with Master: f4fb553e1c0a429fa91320d085ebd96c (127.0.176.193:37355)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
I20260812 06:13:03.062288 1562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:44795
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:13:03.078936 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36077
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:03.166365 1883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:03.166630 1883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:03.166659 1883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:03.168061 1883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:03.168128 1883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:03.168160 1883 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:03.169831 1883 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36077
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:03.170091 1883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:03.170315 1883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:03.176360 1897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:03.176375 1893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:03.176573 1892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:03.176937 1883 server_base.cc:1034] running on GCE node
I20260812 06:13:03.177193 1883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:03.177429 1883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:03.178666 1883 hybrid_clock.cc:648] HybridClock initialized: now 1786515183178556 us; error 108 us; skew 500 ppm
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[1488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515183, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:03.182569 1883 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:13:03.183315 1883 webserver.cc:460] Webserver started at http://127.0.176.194:41095/ using document root <none> and password file <none>
I20260812 06:13:03.183636 1883 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:03.183714 1883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:03.183890 1883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:03.185108 1883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "0c9eecbc730c44899912ca1824b62786"
format_stamp: "Formatted at 2026-08-12 06:13:03 on dist-test-slave-gw5c"
server_key: "429aa1159c8e8d5eaf097c8ebff30295"
server_key_iv: "adaa30128f3550e8ac91bdcdaf131d96"
server_key_version: "encryptionkey@0"
I20260812 06:13:03.185519 1883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "0c9eecbc730c44899912ca1824b62786"
format_stamp: "Formatted at 2026-08-12 06:13:03 on dist-test-slave-gw5c"
server_key: "429aa1159c8e8d5eaf097c8ebff30295"
server_key_iv: "adaa30128f3550e8ac91bdcdaf131d96"
server_key_version: "encryptionkey@0"
I20260812 06:13:03.186996 1883 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:03.187963 1908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:03.188174 1883 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:13:03.188293 1883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "0c9eecbc730c44899912ca1824b62786"
format_stamp: "Formatted at 2026-08-12 06:13:03 on dist-test-slave-gw5c"
server_key: "429aa1159c8e8d5eaf097c8ebff30295"
server_key_iv: "adaa30128f3550e8ac91bdcdaf131d96"
server_key_version: "encryptionkey@0"
I20260812 06:13:03.188385 1883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:03.197554 1883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:03.200182 1883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:03.200369 1883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:03.200637 1883 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:03.200978 1883 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:03.201035 1883 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:03.201081 1883 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:03.201113 1883 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:03.208254 1883 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:39001
I20260812 06:13:03.208299 2074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:39001 every 8 connection(s)
I20260812 06:13:03.208653 1883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[1488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515183, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:03.216071 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 1883
I20260812 06:13:03.216188 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:13:03.216367 707 external_mini_cluster.cc:1428] Setting key 68b08b3fb6a4a774852356a495d928bf
I20260812 06:13:03.219276 1630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.209482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:42617 (local address 127.0.176.254:36077)
0812 06:13:03.209562 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:03.209564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:03.209737 (+ 173us) server_negotiation.cc:407] Connection header received
0812 06:13:03.210243 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:03.210244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:03.210256 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:03.210334 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:03.211309 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.211963 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.212951 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.213155 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.213229 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.215674 (+ 2445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:03.215676 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:03.215676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:03.215685 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:03.217473 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.217982 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.217983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.217984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.218053 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.218441 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.218442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.218442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.218571 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:03.218656 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:03.219087 (+ 431us) server_negotiation.cc:299] Negotiation successful
0812 06:13:03.219182 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 06:13:03.219549 2077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.209390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36077 (local address 127.0.176.194:42617)
0812 06:13:03.209592 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:03.209637 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:03.210138 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:03.210390 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:03.210393 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:03.210997 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:03.211206 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.211211 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.212060 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.212060 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.212857 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.212859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.213241 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.213242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.213363 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.213968 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:03.213977 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:03.215556 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:03.217612 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:03.217623 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:03.217626 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:03.217896 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:03.218150 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:03.218151 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:03.218152 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:03.218332 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:03.218666 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:03.218672 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:03.218902 (+ 230us) client_negotiation.cc:769] Sending connection context
0812 06:13:03.219046 (+ 144us) client_negotiation.cc:240] Negotiation successful
0812 06:13:03.219235 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":101,"threads_started":1}
I20260812 06:13:03.219995 2075 heartbeater.cc:347] Connected to a master server at 127.0.176.254:36077
I20260812 06:13:03.220103 2075 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:03.220319 2075 heartbeater.cc:511] Master 127.0.176.254:36077 requested a full tablet report, sending...
I20260812 06:13:03.220726 1562 ts_manager.cc:194] Registered new tserver with Master: 0c9eecbc730c44899912ca1824b62786 (127.0.176.194:39001)
I20260812 06:13:03.221153 1562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:42617
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:13:03.245957 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36077
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:03.336225 2080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:03.336467 2080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:03.336493 2080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:03.337661 2080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:03.337702 2080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:03.337731 2080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:03.339236 2080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36077
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:03.339514 2080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:03.339727 2080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:03.345014 2099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:03.345032 2095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:03.345350 2093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:03.345453 2080 server_base.cc:1034] running on GCE node
I20260812 06:13:03.345662 2080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:03.345888 2080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:03.347035 2080 hybrid_clock.cc:648] HybridClock initialized: now 1786515183347025 us; error 37 us; skew 500 ppm
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[1488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515183, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:03.349850 2080 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:13:03.350351 2080 webserver.cc:460] Webserver started at http://127.0.176.195:33703/ using document root <none> and password file <none>
I20260812 06:13:03.350602 2080 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:03.350651 2080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:03.350793 2080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:03.352021 2080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "96915cf87c734a83888e843bb87da10b"
format_stamp: "Formatted at 2026-08-12 06:13:03 on dist-test-slave-gw5c"
server_key: "cad356880142a644f263496edd897591"
server_key_iv: "75c900e878064d9b147fdf71cc6c53c4"
server_key_version: "encryptionkey@0"
I20260812 06:13:03.352401 2080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "96915cf87c734a83888e843bb87da10b"
format_stamp: "Formatted at 2026-08-12 06:13:03 on dist-test-slave-gw5c"
server_key: "cad356880142a644f263496edd897591"
server_key_iv: "75c900e878064d9b147fdf71cc6c53c4"
server_key_version: "encryptionkey@0"
I20260812 06:13:03.353958 2080 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:03.354885 2111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:03.355110 2080 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:03.355230 2080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "96915cf87c734a83888e843bb87da10b"
format_stamp: "Formatted at 2026-08-12 06:13:03 on dist-test-slave-gw5c"
server_key: "cad356880142a644f263496edd897591"
server_key_iv: "75c900e878064d9b147fdf71cc6c53c4"
server_key_version: "encryptionkey@0"
I20260812 06:13:03.355315 2080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:03.371182 2080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:03.375358 2080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:03.375646 2080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:03.375957 2080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:03.376375 2080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:03.376418 2080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:03.376453 2080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:03.376474 2080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:03.384945 2080 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:37715
I20260812 06:13:03.385164 2279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:37715 every 8 connection(s)
I20260812 06:13:03.385507 2080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:13:03.392590 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 2080
I20260812 06:13:03.392755 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:13:03.392943 707 external_mini_cluster.cc:1428] Setting key e0f97ca22b688c6ed8496344f7a35fbb
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[1488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515183, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:03.397253 1630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.386463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:44461 (local address 127.0.176.254:36077)
0812 06:13:03.386537 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:03.386540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:03.387005 (+ 465us) server_negotiation.cc:407] Connection header received
0812 06:13:03.387875 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:03.387876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:03.387888 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:03.387961 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:03.389086 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.389639 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.390778 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.390998 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.391061 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.394083 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:03.394084 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:03.394084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:03.394092 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:03.395734 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.396207 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.396208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.396209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.396275 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.396595 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.396596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.396596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.396748 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:03.396826 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:03.397106 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 06:13:03.397182 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 06:13:03.397516 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.386458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36077 (local address 127.0.176.195:44461)
0812 06:13:03.386777 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:03.386837 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:03.387718 (+ 881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:03.388034 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:03.388038 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:03.388725 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:03.388967 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.388974 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.389764 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.389765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.390672 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.390674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.391089 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.391090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.391203 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.391961 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:03.391971 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:03.393990 (+ 2019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:03.395825 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:03.395834 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:03.395836 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:03.396112 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:03.396371 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:03.396372 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:03.396372 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:03.396494 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:03.396835 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:03.396840 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:03.396979 (+ 139us) client_negotiation.cc:769] Sending connection context
0812 06:13:03.397076 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 06:13:03.397219 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":210,"threads_started":1}
I20260812 06:13:03.398353 2280 heartbeater.cc:347] Connected to a master server at 127.0.176.254:36077
I20260812 06:13:03.398501 2280 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:03.398761 2280 heartbeater.cc:511] Master 127.0.176.254:36077 requested a full tablet report, sending...
I20260812 06:13:03.399250 1562 ts_manager.cc:194] Registered new tserver with Master: 96915cf87c734a83888e843bb87da10b (127.0.176.195:37715)
I20260812 06:13:03.399825 1562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:44461
I20260812 06:13:03.405167 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:13:03.416105 1630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.407108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59280 (local address 127.0.176.254:36077)
0812 06:13:03.407219 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:03.407222 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:03.407335 (+ 113us) server_negotiation.cc:407] Connection header received
0812 06:13:03.407509 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:03.407510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:03.407522 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:03.407798 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:03.408562 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.409497 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.410686 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.410903 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.410961 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.412715 (+ 1754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:03.412717 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:03.412717 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:03.412729 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:03.414438 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.414889 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.414890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.414890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.414957 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.415145 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.415145 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.415146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.415491 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:03.415646 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:03.415831 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 06:13:03.415969 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 06:13:03.419806 1562 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59280:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:13:03.424141 1562 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:03.433897 2302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.428749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34444 (local address 127.0.176.195:37715)
0812 06:13:03.428988 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:03.428992 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:03.429007 (+ 15us) server_negotiation.cc:407] Connection header received
0812 06:13:03.429061 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:03.429063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:03.429082 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:03.429166 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:03.429430 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.430563 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.432225 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.433232 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.433329 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.433400 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:03.433752 (+ 352us) server_negotiation.cc:299] Negotiation successful
0812 06:13:03.433805 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":101,"threads_started":1}
I20260812 06:13:03.433889 2299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.428611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:39001 (local address 127.0.0.1:43782)
0812 06:13:03.429067 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:03.429078 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:03.429146 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:03.429343 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:03.429344 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:03.429346 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:03.429413 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.429415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.430852 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.430853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.432099 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.432102 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.433365 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.433366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.433480 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.433503 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 06:13:03.433691 (+ 188us) client_negotiation.cc:240] Negotiation successful
0812 06:13:03.433784 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":40,"thread_start_us":115,"threads_started":1}
I20260812 06:13:03.433900 2303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.428751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43782 (local address 127.0.176.194:39001)
0812 06:13:03.428986 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:03.428992 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:03.429204 (+ 212us) server_negotiation.cc:407] Connection header received
0812 06:13:03.429251 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:03.429253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:03.429267 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:03.429335 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:03.429507 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.430739 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.432298 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.433232 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.433334 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.433400 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:03.433750 (+ 350us) server_negotiation.cc:299] Negotiation successful
0812 06:13:03.433805 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":101,"threads_started":1}
I20260812 06:13:03.434324 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.428605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:37715 (local address 127.0.0.1:34444)
0812 06:13:03.428855 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:03.428904 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:03.428974 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:03.429252 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:03.429255 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:03.429258 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:03.429344 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.429347 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.430690 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.430691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.432098 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.432102 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.433365 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.433366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.433480 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.433503 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 06:13:03.433705 (+ 202us) client_negotiation.cc:240] Negotiation successful
0812 06:13:03.434247 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":534,"thread_start_us":106,"threads_started":1}
I20260812 06:13:03.434768 2304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.428879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:37355 (local address 127.0.0.1:46562)
0812 06:13:03.429124 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:03.429134 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:03.429180 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:03.429479 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:03.429480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:03.429483 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:03.429532 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.429533 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.430935 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.430936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.431982 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.431989 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.434516 (+ 2527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.434517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.434599 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.434606 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 06:13:03.434639 (+ 33us) client_negotiation.cc:240] Negotiation successful
0812 06:13:03.434686 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":82,"threads_started":1}
I20260812 06:13:03.435096 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.429134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46562 (local address 127.0.176.193:37355)
0812 06:13:03.429314 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:03.429319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:03.429328 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:03.429367 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:03.429369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:03.429385 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:03.429468 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:03.429686 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.430783 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.433449 (+ 2666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.434372 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.434890 (+ 518us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.434973 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:03.434997 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 06:13:03.435036 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":108,"threads_started":1}
I20260812 06:13:03.435338 1978 tablet_service.cc:1467] Processing CreateTablet for tablet 0cbaea6df1224725bf24afb73969b5c6 (DEFAULT_TABLE table=test-table [id=6bddbaaf138b4ab8b36ddca408ca3d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:03.435722 1978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cbaea6df1224725bf24afb73969b5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:03.435772 1765 tablet_service.cc:1467] Processing CreateTablet for tablet 0cbaea6df1224725bf24afb73969b5c6 (DEFAULT_TABLE table=test-table [id=6bddbaaf138b4ab8b36ddca408ca3d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:03.436163 1765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cbaea6df1224725bf24afb73969b5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:03.438133 2177 tablet_service.cc:1467] Processing CreateTablet for tablet 0cbaea6df1224725bf24afb73969b5c6 (DEFAULT_TABLE table=test-table [id=6bddbaaf138b4ab8b36ddca408ca3d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:03.438552 2177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cbaea6df1224725bf24afb73969b5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:03.438786 2306 tablet_bootstrap.cc:492] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786: Bootstrap starting.
I20260812 06:13:03.439689 2306 tablet_bootstrap.cc:654] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:03.439829 2307 tablet_bootstrap.cc:492] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c: Bootstrap starting.
I20260812 06:13:03.440445 2306 log.cc:824] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:03.440536 2307 tablet_bootstrap.cc:654] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:03.441159 2307 log.cc:824] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:03.441264 2306 tablet_bootstrap.cc:492] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786: No bootstrap required, opened a new log
I20260812 06:13:03.441336 2306 ts_tablet_manager.cc:1397] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:13:03.442116 2312 tablet_bootstrap.cc:492] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b: Bootstrap starting.
I20260812 06:13:03.442699 2307 tablet_bootstrap.cc:492] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c: No bootstrap required, opened a new log
I20260812 06:13:03.442781 2307 ts_tablet_manager.cc:1397] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:13:03.443033 2312 tablet_bootstrap.cc:654] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:03.443572 2306 raft_consensus.cc:348] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96915cf87c734a83888e843bb87da10b" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37715 } } peers { permanent_uuid: "0c9eecbc730c44899912ca1824b62786" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39001 } } peers { permanent_uuid: "f4fb553e1c0a429fa91320d085ebd96c" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37355 } }
I20260812 06:13:03.443801 2306 raft_consensus.cc:374] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:03.443801 2312 log.cc:824] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:03.443846 2306 raft_consensus.cc:729] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c9eecbc730c44899912ca1824b62786, State: Initialized, Role: FOLLOWER
I20260812 06:13:03.443994 2306 consensus_queue.cc:260] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96915cf87c734a83888e843bb87da10b" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37715 } } peers { permanent_uuid: "0c9eecbc730c44899912ca1824b62786" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39001 } } peers { permanent_uuid: "f4fb553e1c0a429fa91320d085ebd96c" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37355 } }
I20260812 06:13:03.444303 2306 ts_tablet_manager.cc:1428] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:13:03.444482 2075 heartbeater.cc:503] Master 127.0.176.254:36077 was elected leader, sending a full tablet report...
I20260812 06:13:03.444766 2312 tablet_bootstrap.cc:492] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b: No bootstrap required, opened a new log
I20260812 06:13:03.444860 2312 ts_tablet_manager.cc:1397] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:13:03.444974 2307 raft_consensus.cc:348] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96915cf87c734a83888e843bb87da10b" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37715 } } peers { permanent_uuid: "0c9eecbc730c44899912ca1824b62786" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39001 } } peers { permanent_uuid: "f4fb553e1c0a429fa91320d085ebd96c" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37355 } }
I20260812 06:13:03.445159 2307 raft_consensus.cc:374] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:03.445199 2307 raft_consensus.cc:729] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4fb553e1c0a429fa91320d085ebd96c, State: Initialized, Role: FOLLOWER
I20260812 06:13:03.445412 2307 consensus_queue.cc:260] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96915cf87c734a83888e843bb87da10b" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37715 } } peers { permanent_uuid: "0c9eecbc730c44899912ca1824b62786" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39001 } } peers { permanent_uuid: "f4fb553e1c0a429fa91320d085ebd96c" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37355 } }
I20260812 06:13:03.445760 2307 ts_tablet_manager.cc:1428] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:13:03.445760 1872 heartbeater.cc:503] Master 127.0.176.254:36077 was elected leader, sending a full tablet report...
I20260812 06:13:03.447232 2312 raft_consensus.cc:348] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96915cf87c734a83888e843bb87da10b" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37715 } } peers { permanent_uuid: "0c9eecbc730c44899912ca1824b62786" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39001 } } peers { permanent_uuid: "f4fb553e1c0a429fa91320d085ebd96c" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37355 } }
I20260812 06:13:03.447403 2312 raft_consensus.cc:374] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:03.447480 2312 raft_consensus.cc:729] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96915cf87c734a83888e843bb87da10b, State: Initialized, Role: FOLLOWER
I20260812 06:13:03.447611 2312 consensus_queue.cc:260] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96915cf87c734a83888e843bb87da10b" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37715 } } peers { permanent_uuid: "0c9eecbc730c44899912ca1824b62786" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39001 } } peers { permanent_uuid: "f4fb553e1c0a429fa91320d085ebd96c" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37355 } }
I20260812 06:13:03.447901 2312 ts_tablet_manager.cc:1428] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260812 06:13:03.447939 2280 heartbeater.cc:503] Master 127.0.176.254:36077 was elected leader, sending a full tablet report...
W20260812 06:13:03.459276 2076 tablet.cc:2369] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:13:03.546839 1873 tablet.cc:2369] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:13:03.636355 2281 tablet.cc:2369] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:13:03.672854 2317 raft_consensus.cc:482] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:03.673012 2317 raft_consensus.cc:504] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96915cf87c734a83888e843bb87da10b" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37715 } } peers { permanent_uuid: "0c9eecbc730c44899912ca1824b62786" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39001 } } peers { permanent_uuid: "f4fb553e1c0a429fa91320d085ebd96c" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37355 } }
I20260812 06:13:03.673499 2317 leader_election.cc:288] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c9eecbc730c44899912ca1824b62786 (127.0.176.194:39001), f4fb553e1c0a429fa91320d085ebd96c (127.0.176.193:37355)
I20260812 06:13:03.676580 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.673898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:35163 (local address 127.0.176.193:37355)
0812 06:13:03.674003 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:03.674007 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:03.674033 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:13:03.674066 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:03.674067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:03.674079 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:03.674150 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:03.674339 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.674819 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.675846 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.676215 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.676304 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.676314 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:03.676471 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 06:13:03.676509 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 06:13:03.676580 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.673785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:37355 (local address 127.0.176.195:35163)
0812 06:13:03.673850 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:03.673863 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:03.673924 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:03.674158 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:03.674160 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:03.674161 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:03.674240 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.674241 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.674917 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.674918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.675748 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.675750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.676304 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.676305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.676387 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.676390 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:03.676462 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:13:03.676505 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 06:13:03.676751 2303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.673884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:37141 (local address 127.0.176.194:39001)
0812 06:13:03.673939 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:03.673941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:03.674101 (+ 160us) server_negotiation.cc:407] Connection header received
0812 06:13:03.674189 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:03.674190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:03.674201 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:03.674280 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:03.674561 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.675025 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.675999 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.676392 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.676488 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.676496 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:03.676650 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 06:13:03.676686 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:13:03.676761 2318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.673785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:39001 (local address 127.0.176.195:37141)
0812 06:13:03.674001 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:03.674010 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:03.674115 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:03.674283 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:03.674284 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:03.674286 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:03.674459 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.674468 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.675115 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.675116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.675893 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:03.675895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.676498 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.676500 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:03.676576 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.676579 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:03.676643 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 06:13:03.676681 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":17,"thread_start_us":125,"threads_started":1}
I20260812 06:13:03.676978 1793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cbaea6df1224725bf24afb73969b5c6" candidate_uuid: "96915cf87c734a83888e843bb87da10b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4fb553e1c0a429fa91320d085ebd96c" is_pre_election: true
I20260812 06:13:03.677102 2009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cbaea6df1224725bf24afb73969b5c6" candidate_uuid: "96915cf87c734a83888e843bb87da10b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9eecbc730c44899912ca1824b62786" is_pre_election: true
I20260812 06:13:03.677160 1793 raft_consensus.cc:2454] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96915cf87c734a83888e843bb87da10b in term 0.
I20260812 06:13:03.677225 2009 raft_consensus.cc:2454] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96915cf87c734a83888e843bb87da10b in term 0.
I20260812 06:13:03.677439 2113 leader_election.cc:302] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96915cf87c734a83888e843bb87da10b, f4fb553e1c0a429fa91320d085ebd96c; no voters:
I20260812 06:13:03.677596 2317 raft_consensus.cc:2781] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:03.677656 2317 raft_consensus.cc:482] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:03.677675 2317 raft_consensus.cc:3037] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:03.678443 2317 raft_consensus.cc:504] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96915cf87c734a83888e843bb87da10b" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37715 } } peers { permanent_uuid: "0c9eecbc730c44899912ca1824b62786" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39001 } } peers { permanent_uuid: "f4fb553e1c0a429fa91320d085ebd96c" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37355 } }
I20260812 06:13:03.678606 2317 leader_election.cc:288] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [CANDIDATE]: Term 1 election: Requested vote from peers 0c9eecbc730c44899912ca1824b62786 (127.0.176.194:39001), f4fb553e1c0a429fa91320d085ebd96c (127.0.176.193:37355)
I20260812 06:13:03.678923 2009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cbaea6df1224725bf24afb73969b5c6" candidate_uuid: "96915cf87c734a83888e843bb87da10b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9eecbc730c44899912ca1824b62786"
I20260812 06:13:03.679009 2009 raft_consensus.cc:3037] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:03.679781 2009 raft_consensus.cc:2454] T 0cbaea6df1224725bf24afb73969b5c6 P 0c9eecbc730c44899912ca1824b62786 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96915cf87c734a83888e843bb87da10b in term 1.
I20260812 06:13:03.679901 1793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cbaea6df1224725bf24afb73969b5c6" candidate_uuid: "96915cf87c734a83888e843bb87da10b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4fb553e1c0a429fa91320d085ebd96c"
I20260812 06:13:03.680002 2115 leader_election.cc:302] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c9eecbc730c44899912ca1824b62786, 96915cf87c734a83888e843bb87da10b; no voters:
I20260812 06:13:03.680020 1793 raft_consensus.cc:3037] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:03.680115 2317 raft_consensus.cc:2781] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:03.680369 2317 raft_consensus.cc:686] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [term 1 LEADER]: Becoming Leader. State: Replica: 96915cf87c734a83888e843bb87da10b, State: Running, Role: LEADER
I20260812 06:13:03.680485 2317 consensus_queue.cc:237] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96915cf87c734a83888e843bb87da10b" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37715 } } peers { permanent_uuid: "0c9eecbc730c44899912ca1824b62786" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39001 } } peers { permanent_uuid: "f4fb553e1c0a429fa91320d085ebd96c" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37355 } }
I20260812 06:13:03.680886 1793 raft_consensus.cc:2454] T 0cbaea6df1224725bf24afb73969b5c6 P f4fb553e1c0a429fa91320d085ebd96c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96915cf87c734a83888e843bb87da10b in term 1.
I20260812 06:13:03.681602 1561 catalog_manager.cc:5495] T 0cbaea6df1224725bf24afb73969b5c6 P 96915cf87c734a83888e843bb87da10b reported cstate change: term changed from 0 to 1, leader changed from <none> to 96915cf87c734a83888e843bb87da10b (127.0.176.195). New cstate: current_term: 1 leader_uuid: "96915cf87c734a83888e843bb87da10b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96915cf87c734a83888e843bb87da10b" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c9eecbc730c44899912ca1824b62786" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4fb553e1c0a429fa91320d085ebd96c" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37355 } health_report { overall_health: UNKNOWN } } }
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[1488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.193@KRBTEST.COM
I20260812 06:13:03.725521 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.716671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46564 (local address 127.0.176.193:37355)
0812 06:13:03.716761 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:03.716764 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:03.716832 (+ 68us) server_negotiation.cc:407] Connection header received
0812 06:13:03.716884 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:03.716885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:03.716895 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:03.716951 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:03.717614 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.718164 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.719010 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.719198 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.719259 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.722036 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:03.722059 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:03.722060 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:03.722067 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:03.724189 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.724595 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.724599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.724599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.724677 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.724897 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.724898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.724898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.725058 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:03.725229 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:03.725293 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 06:13:03.725386 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[1488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515183, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[1488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515183, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.176.193@KRBTEST.COM
I20260812 06:13:03.753162 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.745767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46572 (local address 127.0.176.193:37355)
0812 06:13:03.745868 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:03.745870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:03.745954 (+ 84us) server_negotiation.cc:407] Connection header received
0812 06:13:03.746007 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:03.746007 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:03.746016 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:03.746070 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:03.746687 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.747186 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.748028 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.748225 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.748288 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.750636 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:03.750638 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:03.750638 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:03.750645 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:03.752137 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.752446 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.752446 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.752447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.752499 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.752658 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.752658 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.752659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.752749 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:03.752844 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:03.752984 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 06:13:03.753048 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[1488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515183, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[1488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515183, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.193@KRBTEST.COM
I20260812 06:13:03.777706 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:03.770254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46578 (local address 127.0.176.193:37355)
0812 06:13:03.770334 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:03.770337 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:03.770434 (+ 97us) server_negotiation.cc:407] Connection header received
0812 06:13:03.770532 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:03.770533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:03.770544 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:03.770628 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:03.771212 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.771774 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.772528 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:03.772724 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:03.772801 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:03.775014 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:03.775016 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:03.775016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:03.775024 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:03.776486 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.776871 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.776872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.776873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.776940 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:03.777157 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:03.777158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:03.777158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:03.777265 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:03.777371 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:03.777511 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 06:13:03.777596 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260812 06:13:03.778491 1733 tablet_service.cc:2908] Rejecting scan request for tablet 0cbaea6df1224725bf24afb73969b5c6: Uninitialized: clean time has not yet been initialized
I20260812 06:13:03.779716 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 1660
I20260812 06:13:03.792546 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 1883
I20260812 06:13:03.811937 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 2080
I20260812 06:13:03.832293 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 1508
2026-08-12T06:13:03Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2554 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[2339](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[2339](info): set up 2 sockets
Aug 12 06:13:03 dist-test-slave-gw5c krb5kdc[2339](info): commencing operation
krb5kdc: starting...
W20260812 06:13:05.154266 707 mini_kdc.cc:121] Time spent starting KDC: real 1.290s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:05 dist-test-slave-gw5c krb5kdc[2339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:13:05.290169 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:38001
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:38001
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:05.385605 2356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:05.385907 2356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:05.385951 2356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:05.387290 2356 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:05.387379 2356 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:13:05.387450 2356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:05.387487 2356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:05.387517 2356 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:05.387544 2356 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:05.389302 2356 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:38001
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:38001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:05.389650 2356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:05.389920 2356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:05.395174 2362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:05.395181 2366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:05.395182 2363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:05.395735 2356 server_base.cc:1034] running on GCE node
I20260812 06:13:05.396034 2356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:05.396379 2356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:05.397588 2356 hybrid_clock.cc:648] HybridClock initialized: now 1786515185397568 us; error 35 us; skew 500 ppm
Aug 12 06:13:05 dist-test-slave-gw5c krb5kdc[2339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515185, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:05.404085 2356 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:13:05.404681 2356 webserver.cc:460] Webserver started at http://127.0.176.254:45657/ using document root <none> and password file <none>
I20260812 06:13:05.404939 2356 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:05.405014 2356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:05.405174 2356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:05.406464 2356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "7b6f661bcee34f80a42992b67620d5ba"
format_stamp: "Formatted at 2026-08-12 06:13:05 on dist-test-slave-gw5c"
server_key: "10fec73523f7b82cb42fc1290230bc91"
server_key_iv: "1d0343e2d1d2beb6c8ac3b1d54fef909"
server_key_version: "encryptionkey@0"
I20260812 06:13:05.407074 2356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "7b6f661bcee34f80a42992b67620d5ba"
format_stamp: "Formatted at 2026-08-12 06:13:05 on dist-test-slave-gw5c"
server_key: "10fec73523f7b82cb42fc1290230bc91"
server_key_iv: "1d0343e2d1d2beb6c8ac3b1d54fef909"
server_key_version: "encryptionkey@0"
I20260812 06:13:05.408797 2356 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260812 06:13:05.410081 2377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:05.410344 2356 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:05.410480 2356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "7b6f661bcee34f80a42992b67620d5ba"
format_stamp: "Formatted at 2026-08-12 06:13:05 on dist-test-slave-gw5c"
server_key: "10fec73523f7b82cb42fc1290230bc91"
server_key_iv: "1d0343e2d1d2beb6c8ac3b1d54fef909"
server_key_version: "encryptionkey@0"
I20260812 06:13:05.410573 2356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:05.418099 2356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:05.420686 2356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:05.420871 2356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:05.426610 2356 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:38001
I20260812 06:13:05.426661 2488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:38001 every 8 connection(s)
I20260812 06:13:05.427063 2356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:05.427215 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 2356
I20260812 06:13:05.427335 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:05.427554 707 external_mini_cluster.cc:1428] Setting key 3ad4ed1f09dd92069e05eb03281a96bb
I20260812 06:13:05.427943 2490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:05.431454 2490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba: Bootstrap starting.
I20260812 06:13:05.432469 2490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:05.432806 2490 log.cc:824] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:05.433588 2490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba: No bootstrap required, opened a new log
Aug 12 06:13:05 dist-test-slave-gw5c krb5kdc[2339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:05.435737 2490 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b6f661bcee34f80a42992b67620d5ba" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38001 } }
I20260812 06:13:05.435922 2490 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:05.435992 2490 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b6f661bcee34f80a42992b67620d5ba, State: Initialized, Role: FOLLOWER
I20260812 06:13:05.436167 2490 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b6f661bcee34f80a42992b67620d5ba" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38001 } }
I20260812 06:13:05.436269 2490 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:05.436316 2490 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:05.436367 2490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:05.436960 2490 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b6f661bcee34f80a42992b67620d5ba" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38001 } }
I20260812 06:13:05.437089 2490 leader_election.cc:302] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b6f661bcee34f80a42992b67620d5ba; no voters:
I20260812 06:13:05.437317 2490 leader_election.cc:288] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:05.437356 2503 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:05.437486 2503 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [term 1 LEADER]: Becoming Leader. State: Replica: 7b6f661bcee34f80a42992b67620d5ba, State: Running, Role: LEADER
I20260812 06:13:05.437628 2490 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:05.437641 2503 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b6f661bcee34f80a42992b67620d5ba" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38001 } }
I20260812 06:13:05.440137 2505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b6f661bcee34f80a42992b67620d5ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b6f661bcee34f80a42992b67620d5ba" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38001 } } }
I20260812 06:13:05.439952 2504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b6f661bcee34f80a42992b67620d5ba. Latest consensus state: current_term: 1 leader_uuid: "7b6f661bcee34f80a42992b67620d5ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b6f661bcee34f80a42992b67620d5ba" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38001 } } }
I20260812 06:13:05.439884 2499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:05.428133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34100 (local address 127.0.176.254:38001)
0812 06:13:05.428344 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:05.428352 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:05.428379 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:13:05.429098 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:05.429106 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:05.429156 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:05.429275 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:05.430131 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.431088 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.432383 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.432903 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.433039 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:05.435599 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:05.435606 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:05.435606 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:05.435624 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:05.437753 (+ 2129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:05.438149 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:05.438152 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:05.438153 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:05.438277 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:05.438566 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:05.438567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:05.438567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:05.438982 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:05.439124 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:05.439323 (+ 199us) server_negotiation.cc:299] Negotiation successful
0812 06:13:05.439656 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":109,"threads_started":1}
I20260812 06:13:05.440217 2505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:05.440240 2504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba [sys.catalog]: This master's current role is: LEADER
W20260812 06:13:05.441006 2522 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:13:05.441067 2522 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:13:05.441133 2524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:05.441318 2524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:05.442914 2524 catalog_manager.cc:1347] Generated new cluster ID: cff8be4a8dde462eb30d2d8c0b89740e
I20260812 06:13:05.442987 2524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:05.457558 2524 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:05.458165 2524 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:05.464286 2524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba: Generated new TSK 0
I20260812 06:13:05.464540 2524 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:13:05.504652 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:38001
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:05.602185 2538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:05.602420 2538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:05.602449 2538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:05.603796 2538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:05.603847 2538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:05.603870 2538 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:13:05.603889 2538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:05.605741 2538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.176.254:38001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:05.606019 2538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:05.606281 2538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:05.612025 2546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:05.612025 2550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:05.612025 2544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:05.612295 2538 server_base.cc:1034] running on GCE node
I20260812 06:13:05.612620 2538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:05.612998 2538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:05.614161 2538 hybrid_clock.cc:648] HybridClock initialized: now 1786515185614147 us; error 33 us; skew 500 ppm
Aug 12 06:13:05 dist-test-slave-gw5c krb5kdc[2339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515185, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:05.617014 2538 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:13:05.617519 2538 webserver.cc:460] Webserver started at http://127.0.176.193:34759/ using document root <none> and password file <none>
I20260812 06:13:05.617790 2538 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:05.617866 2538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:05.618024 2538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:05.619149 2538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40"
format_stamp: "Formatted at 2026-08-12 06:13:05 on dist-test-slave-gw5c"
server_key: "1877d941b0082c1a688e10408b2ec690"
server_key_iv: "957b75c35b3d2214df6c5c4873851b5c"
server_key_version: "encryptionkey@0"
I20260812 06:13:05.619598 2538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40"
format_stamp: "Formatted at 2026-08-12 06:13:05 on dist-test-slave-gw5c"
server_key: "1877d941b0082c1a688e10408b2ec690"
server_key_iv: "957b75c35b3d2214df6c5c4873851b5c"
server_key_version: "encryptionkey@0"
I20260812 06:13:05.621160 2538 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:05.621991 2559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:05.622177 2538 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:05.622278 2538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40"
format_stamp: "Formatted at 2026-08-12 06:13:05 on dist-test-slave-gw5c"
server_key: "1877d941b0082c1a688e10408b2ec690"
server_key_iv: "957b75c35b3d2214df6c5c4873851b5c"
server_key_version: "encryptionkey@0"
I20260812 06:13:05.622362 2538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:05.647714 2538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:05.650723 2538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:05.650929 2538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:05.651655 2538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:05.651721 2538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:05.651758 2538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:05.651786 2538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:05.659684 2538 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:35309
I20260812 06:13:05.659778 2745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:35309 every 8 connection(s)
I20260812 06:13:05.660158 2538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:13:05 dist-test-slave-gw5c krb5kdc[2339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515185, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:05.662153 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 2538
I20260812 06:13:05.662246 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:05.662453 707 external_mini_cluster.cc:1428] Setting key 325df36b9a22063042a43a6aa104ecba
I20260812 06:13:05.664148 2499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:05.652641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:50599 (local address 127.0.176.254:38001)
0812 06:13:05.652711 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:05.652713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:05.652912 (+ 199us) server_negotiation.cc:407] Connection header received
0812 06:13:05.653691 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:05.653698 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:05.653747 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:05.653874 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:05.654969 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.655718 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.657554 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.657779 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.657844 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:05.660921 (+ 3077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:05.660922 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:05.660923 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:05.660931 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:05.662613 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:05.663064 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:05.663065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:05.663065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:05.663132 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:05.663437 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:05.663438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:05.663438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:05.663569 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:05.663648 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:05.663957 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 06:13:05.664055 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 06:13:05.664381 2578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:05.652568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:38001 (local address 127.0.176.193:50599)
0812 06:13:05.652775 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:05.652815 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:05.653472 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:05.654008 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:05.654016 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:05.654423 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:05.654813 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:05.654822 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.655859 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.655860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:05.657439 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:05.657443 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.657890 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.657892 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:05.658071 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:05.658800 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:05.658812 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:05.660802 (+ 1990us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:05.662701 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:05.662712 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:05.662714 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:05.662968 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:05.663198 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:05.663199 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:05.663200 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:05.663329 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:05.663639 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:05.663648 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:05.663808 (+ 160us) client_negotiation.cc:769] Sending connection context
0812 06:13:05.663922 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 06:13:05.664105 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":85,"threads_started":1}
I20260812 06:13:05.664924 2746 heartbeater.cc:347] Connected to a master server at 127.0.176.254:38001
I20260812 06:13:05.665094 2746 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:05.665391 2746 heartbeater.cc:511] Master 127.0.176.254:38001 requested a full tablet report, sending...
I20260812 06:13:05.666522 2406 ts_manager.cc:194] Registered new tserver with Master: f6d0a4ff01944df9bc8ca8a10ee38b40 (127.0.176.193:35309)
I20260812 06:13:05.667289 2406 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:50599
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
I20260812 06:13:05.673318 2758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:05.666337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:38001 (local address 127.0.176.193:37219)
0812 06:13:05.666490 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:05.666502 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:05.666570 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:05.666721 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:05.666721 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:05.666961 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:05.667040 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:05.667042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.667863 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.667864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:05.668805 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:05.668809 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.669172 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.669173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:05.669253 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:05.669755 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:05.669762 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:05.670244 (+ 482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:05.671975 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:05.671976 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:05.671977 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:05.672225 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:05.672475 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:05.672476 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:05.672476 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:05.672553 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:05.672942 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:05.672943 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:05.673000 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 06:13:05.673091 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 06:13:05.673213 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
I20260812 06:13:05.673312 2499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:05.666379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:37219 (local address 127.0.176.254:38001)
0812 06:13:05.666416 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:05.666418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:05.666575 (+ 157us) server_negotiation.cc:407] Connection header received
0812 06:13:05.666624 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:05.666625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:05.666636 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:05.666701 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:05.667125 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.667748 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.668899 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.669086 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.669147 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:05.670358 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:05.670359 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:05.670360 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:05.670366 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:05.671890 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:05.672332 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:05.672333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:05.672333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:05.672398 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:05.672666 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:05.672667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:05.672667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:05.672791 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:05.672929 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:05.673119 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 06:13:05.673211 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:13:05.692102 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:38001
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:05.778568 2760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:05.778836 2760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:05.778864 2760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:05.780469 2760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:05.780675 2760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:05.780714 2760 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:13:05.780799 2760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:05.783231 2760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.176.254:38001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2760
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:05.783632 2760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:05.783918 2760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:05.789176 2766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:05.789215 2765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:05.789183 2768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:05.789348 2760 server_base.cc:1034] running on GCE node
I20260812 06:13:05.789753 2760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:05.790040 2760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:05.791195 2760 hybrid_clock.cc:648] HybridClock initialized: now 1786515185791172 us; error 39 us; skew 500 ppm
Aug 12 06:13:05 dist-test-slave-gw5c krb5kdc[2339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515185, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:05.794904 2760 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:13:05.795579 2760 webserver.cc:460] Webserver started at http://127.0.176.194:41845/ using document root <none> and password file <none>
I20260812 06:13:05.795864 2760 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:05.795943 2760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:05.796128 2760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:05.797312 2760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "9879cda1e93048079830f378368e7279"
format_stamp: "Formatted at 2026-08-12 06:13:05 on dist-test-slave-gw5c"
server_key: "a77695d6af497192f55b98be5cc66268"
server_key_iv: "1479f9b485aac8a38159beff1f664060"
server_key_version: "encryptionkey@0"
I20260812 06:13:05.797744 2760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "9879cda1e93048079830f378368e7279"
format_stamp: "Formatted at 2026-08-12 06:13:05 on dist-test-slave-gw5c"
server_key: "a77695d6af497192f55b98be5cc66268"
server_key_iv: "1479f9b485aac8a38159beff1f664060"
server_key_version: "encryptionkey@0"
I20260812 06:13:05.799377 2760 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:05.800412 2776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:05.800691 2760 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:05.800910 2760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "9879cda1e93048079830f378368e7279"
format_stamp: "Formatted at 2026-08-12 06:13:05 on dist-test-slave-gw5c"
server_key: "a77695d6af497192f55b98be5cc66268"
server_key_iv: "1479f9b485aac8a38159beff1f664060"
server_key_version: "encryptionkey@0"
I20260812 06:13:05.800998 2760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:05.814699 2760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:05.817566 2760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:05.817771 2760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:05.818454 2760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:05.818511 2760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:05.818554 2760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:05.818604 2760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:13:05 dist-test-slave-gw5c krb5kdc[2339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515185, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:05.826471 2760 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:36877
I20260812 06:13:05.826910 2955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:36877 every 8 connection(s)
I20260812 06:13:05.826990 2760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:13:05.828351 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 2760
I20260812 06:13:05.828457 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:13:05.828655 707 external_mini_cluster.cc:1428] Setting key 8d5cbffc85635bb8df71b29476ec4842
I20260812 06:13:05.829610 2499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:05.818891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:51749 (local address 127.0.176.254:38001)
0812 06:13:05.818983 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:05.818987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:05.819218 (+ 231us) server_negotiation.cc:407] Connection header received
0812 06:13:05.819861 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:05.819862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:05.819876 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:05.819933 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:05.820786 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.821337 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.822464 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.822680 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.822764 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:05.825961 (+ 3197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:05.825964 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:05.825964 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:05.825973 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:05.827767 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:05.828277 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:05.828278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:05.828279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:05.828368 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:05.828718 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:05.828719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:05.828720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:05.828844 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:05.828936 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:05.829395 (+ 459us) server_negotiation.cc:299] Negotiation successful
0812 06:13:05.829492 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:13:05.829737 2790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:05.818877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:38001 (local address 127.0.176.194:51749)
0812 06:13:05.819075 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:05.819118 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:05.819740 (+ 622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:05.820008 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:05.820012 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:05.820472 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:05.820685 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:05.820690 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.821449 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.821450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:05.822363 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:05.822365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.822786 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.822787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:05.822934 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:05.823591 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:05.823600 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:05.825841 (+ 2241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:05.827890 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:05.827898 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:05.827900 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:05.828143 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:05.828488 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:05.828489 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:05.828490 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:05.828641 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:05.829039 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:05.829047 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:05.829216 (+ 169us) client_negotiation.cc:769] Sending connection context
0812 06:13:05.829344 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 06:13:05.829524 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":117,"threads_started":1}
I20260812 06:13:05.830292 2956 heartbeater.cc:347] Connected to a master server at 127.0.176.254:38001
I20260812 06:13:05.830420 2956 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:05.830634 2956 heartbeater.cc:511] Master 127.0.176.254:38001 requested a full tablet report, sending...
I20260812 06:13:05.831041 2405 ts_manager.cc:194] Registered new tserver with Master: 9879cda1e93048079830f378368e7279 (127.0.176.194:36877)
I20260812 06:13:05.831622 2405 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:51749
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
I20260812 06:13:05.839640 2965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:05.831497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:38001 (local address 127.0.176.194:57669)
0812 06:13:05.831629 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:05.831640 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:05.831733 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:05.831864 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:05.831865 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:05.832118 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:05.832186 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:05.832189 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.833135 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.833136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:05.834036 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:05.834039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.834392 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.834393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:05.834481 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:05.835033 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:05.835039 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:05.835541 (+ 502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:05.838075 (+ 2534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:05.838077 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:05.838077 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:05.838403 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:05.838762 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:05.838763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:05.838763 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:05.838850 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:05.839188 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:05.839189 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:05.839257 (+ 68us) client_negotiation.cc:769] Sending connection context
0812 06:13:05.839337 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 06:13:05.839496 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":71,"threads_started":1}
I20260812 06:13:05.839567 2499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:05.831559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:57669 (local address 127.0.176.254:38001)
0812 06:13:05.831605 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:05.831607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:05.831769 (+ 162us) server_negotiation.cc:407] Connection header received
0812 06:13:05.831792 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:05.831793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:05.831803 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:05.831850 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:05.832282 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.833026 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.834128 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.834307 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.834366 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:05.835774 (+ 1408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:05.835777 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:05.835777 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:05.835789 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:05.837936 (+ 2147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:05.838503 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:05.838505 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:05.838506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:05.838604 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:05.838926 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:05.838927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:05.838927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:05.839109 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:05.839172 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:05.839353 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 06:13:05.839495 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:13:05.858995 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:38001
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:05.945274 2968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:05.945564 2968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:05.945612 2968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:05.946838 2968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:05.946908 2968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:05.946947 2968 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:13:05.947005 2968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:05.948696 2968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.176.254:38001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:05.949012 2968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:05.949265 2968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:05.954715 2977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:05.954771 2976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:05.954819 2979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:05.954808 2968 server_base.cc:1034] running on GCE node
I20260812 06:13:05.955284 2968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:05.955611 2968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:05.956797 2968 hybrid_clock.cc:648] HybridClock initialized: now 1786515185956755 us; error 77 us; skew 500 ppm
Aug 12 06:13:05 dist-test-slave-gw5c krb5kdc[2339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515185, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:05.959677 2968 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:13:05.960148 2968 webserver.cc:460] Webserver started at http://127.0.176.195:36551/ using document root <none> and password file <none>
I20260812 06:13:05.960405 2968 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:05.960479 2968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:05.960636 2968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:05.961747 2968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "2c97e8e23dac4345b2e405e64e30ea77"
format_stamp: "Formatted at 2026-08-12 06:13:05 on dist-test-slave-gw5c"
server_key: "67b916ec945c22c34c01820180fa708a"
server_key_iv: "3907d7e8b2e91cf6c8e6b271153d222e"
server_key_version: "encryptionkey@0"
I20260812 06:13:05.962141 2968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "2c97e8e23dac4345b2e405e64e30ea77"
format_stamp: "Formatted at 2026-08-12 06:13:05 on dist-test-slave-gw5c"
server_key: "67b916ec945c22c34c01820180fa708a"
server_key_iv: "3907d7e8b2e91cf6c8e6b271153d222e"
server_key_version: "encryptionkey@0"
I20260812 06:13:05.963739 2968 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:13:05.964757 2991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:05.965058 2968 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:05.965202 2968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "2c97e8e23dac4345b2e405e64e30ea77"
format_stamp: "Formatted at 2026-08-12 06:13:05 on dist-test-slave-gw5c"
server_key: "67b916ec945c22c34c01820180fa708a"
server_key_iv: "3907d7e8b2e91cf6c8e6b271153d222e"
server_key_version: "encryptionkey@0"
I20260812 06:13:05.965307 2968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:05.982235 2968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:05.984556 2968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:05.984686 2968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:05.985385 2968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:05.985451 2968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:05.985494 2968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:05.985510 2968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:13:05 dist-test-slave-gw5c krb5kdc[2339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515185, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:05.993060 2968 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:38443
I20260812 06:13:05.993170 3168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:38443 every 8 connection(s)
I20260812 06:13:05.993489 2968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:13:05.995620 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 2968
I20260812 06:13:05.995726 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:13:05.995752 2499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:05.985975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:55711 (local address 127.0.176.254:38001)
0812 06:13:05.986052 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:05.986055 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:05.986302 (+ 247us) server_negotiation.cc:407] Connection header received
0812 06:13:05.986809 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:05.986811 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:05.986824 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:05.986883 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:05.987581 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.988093 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.989133 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.989363 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.989454 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:05.992523 (+ 3069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:05.992524 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:05.992524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:05.992532 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:05.994347 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:05.994782 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:05.994784 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:05.994784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:05.994846 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:05.995061 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:05.995062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:05.995062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:05.995180 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:05.995237 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:05.995541 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 06:13:05.995632 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 06:13:05.995939 707 external_mini_cluster.cc:1428] Setting key 4d933cc6be7608e9662ba82baad05aa0
I20260812 06:13:05.995936 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:05.985944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:38001 (local address 127.0.176.195:55711)
0812 06:13:05.986135 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:05.986193 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:05.986697 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:05.986967 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:05.986970 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:05.987222 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:05.987491 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:05.987496 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.988194 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.988194 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:05.989020 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:05.989022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.989468 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.989468 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:05.989596 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:05.990163 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:05.990172 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:05.992403 (+ 2231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:05.994423 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:05.994426 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:05.994428 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:05.994676 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:05.994911 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:05.994912 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:05.994912 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:05.995006 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:05.995228 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:05.995231 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:05.995356 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 06:13:05.995519 (+ 163us) client_negotiation.cc:240] Negotiation successful
0812 06:13:05.995665 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260812 06:13:05.996495 3170 heartbeater.cc:347] Connected to a master server at 127.0.176.254:38001
I20260812 06:13:05.996634 3170 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:05.996896 3170 heartbeater.cc:511] Master 127.0.176.254:38001 requested a full tablet report, sending...
I20260812 06:13:05.997344 2405 ts_manager.cc:194] Registered new tserver with Master: 2c97e8e23dac4345b2e405e64e30ea77 (127.0.176.195:38443)
I20260812 06:13:05.997896 2405 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:55711
I20260812 06:13:06.003854 2499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:05.997767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:39953 (local address 127.0.176.254:38001)
0812 06:13:05.997812 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:05.997814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:05.997938 (+ 124us) server_negotiation.cc:407] Connection header received
0812 06:13:05.997968 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:05.997969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:05.997980 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:05.998042 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:05.998557 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.999033 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.999882 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.000086 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.000153 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.001179 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:06.001180 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:06.001180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:06.001190 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:06.002713 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:06.003057 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:06.003058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:06.003058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:06.003111 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:06.003356 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:06.003357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:06.003357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:06.003517 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:06.003571 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.003719 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.003782 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:13:06.003882 3182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:05.997636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:38001 (local address 127.0.176.195:39953)
0812 06:13:05.997860 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:05.997871 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:05.997931 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:05.998144 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:05.998145 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:05.998387 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:05.998458 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:05.998460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:05.999148 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:05.999149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:05.999785 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:05.999788 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.000184 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.000185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.000246 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.000737 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:06.000741 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:06.001064 (+ 323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:06.002807 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:06.002808 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:06.002808 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:06.002987 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:06.003175 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:06.003175 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:06.003176 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:06.003232 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:06.003582 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:06.003583 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:06.003630 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.003701 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.003798 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":99,"threads_started":1}
I20260812 06:13:06.008241 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:13:06 dist-test-slave-gw5c krb5kdc[2339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515186, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:13:06 dist-test-slave-gw5c krb5kdc[2339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515186, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:06.035332 2499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.026538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34116 (local address 127.0.176.254:38001)
0812 06:13:06.026621 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.026624 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.026635 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:06.026670 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.026671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.026680 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.026734 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:06.027374 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.028031 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.028816 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.029016 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.029075 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.031837 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:06.031838 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:06.031839 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:06.031847 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:06.033958 (+ 2111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:06.034364 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:06.034365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:06.034366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:06.034440 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:06.034659 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:06.034660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:06.034660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:06.034813 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:06.034912 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.035102 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.035212 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 06:13:06.037298 2405 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:13:06.039760 2405 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:06.047115 3201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.042652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:36877 (local address 127.0.0.1:44588)
0812 06:13:06.043007 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:06.043054 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:06.043131 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:06.043492 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:06.043495 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:06.043498 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:06.043578 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.043581 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.044713 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.044714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.045787 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.045790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.046750 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.046751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.046849 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.046865 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.046954 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.047018 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":86,"threads_started":1}
I20260812 06:13:06.047214 3204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.042809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44588 (local address 127.0.176.194:36877)
0812 06:13:06.043243 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.043248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.043258 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:06.043345 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.043348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.043365 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.043473 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:06.043667 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.044627 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.045883 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.046658 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.046733 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.046806 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.047051 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.047096 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":94,"threads_started":1}
I20260812 06:13:06.047748 3205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.042841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47682 (local address 127.0.176.195:38443)
0812 06:13:06.043606 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.043611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.043621 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:06.043659 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.043661 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.043675 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.043759 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:06.043992 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.045089 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.046449 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.047323 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.047445 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.047521 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.047616 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.047654 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":119,"threads_started":1}
I20260812 06:13:06.048130 3209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.043023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59854 (local address 127.0.176.193:35309)
0812 06:13:06.043231 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.043236 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.043935 (+ 699us) server_negotiation.cc:407] Connection header received
0812 06:13:06.043986 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.043988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.044004 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.044086 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:06.044245 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.045279 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.046319 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.046899 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.046962 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.047034 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.047976 (+ 942us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.048032 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":98,"threads_started":1}
I20260812 06:13:06.048026 2856 tablet_service.cc:1467] Processing CreateTablet for tablet 143a5bbf2c4a4fdfb44493b526505847 (DEFAULT_TABLE table=test-table [id=a2fb2b431a744a4b8c58ec33572d43e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:06.047780 3206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.042895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:35309 (local address 127.0.0.1:59854)
0812 06:13:06.043848 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:06.043858 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:06.043916 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:06.044102 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:06.044103 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:06.044106 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:06.044161 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.044162 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.045369 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.045370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.046225 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.046227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.047069 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.047070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.047141 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.047145 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.047662 (+ 517us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.047712 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":932,"thread_start_us":69,"threads_started":1}
I20260812 06:13:06.047940 3203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.042716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:38443 (local address 127.0.0.1:47682)
0812 06:13:06.043048 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:06.043067 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:06.043146 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:06.043805 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:06.043805 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:06.043807 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:06.043879 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.043881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.045186 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.045187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.046347 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.046350 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.047459 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.047460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.047534 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.047539 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.047601 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.047643 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":114,"threads_started":1}
I20260812 06:13:06.048493 2856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 143a5bbf2c4a4fdfb44493b526505847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:06.048970 2637 tablet_service.cc:1467] Processing CreateTablet for tablet 143a5bbf2c4a4fdfb44493b526505847 (DEFAULT_TABLE table=test-table [id=a2fb2b431a744a4b8c58ec33572d43e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:06.049333 2637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 143a5bbf2c4a4fdfb44493b526505847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:06.051810 3073 tablet_service.cc:1467] Processing CreateTablet for tablet 143a5bbf2c4a4fdfb44493b526505847 (DEFAULT_TABLE table=test-table [id=a2fb2b431a744a4b8c58ec33572d43e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:06.052183 3073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 143a5bbf2c4a4fdfb44493b526505847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:06.053066 3210 tablet_bootstrap.cc:492] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279: Bootstrap starting.
I20260812 06:13:06.053433 3211 tablet_bootstrap.cc:492] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40: Bootstrap starting.
I20260812 06:13:06.053900 3210 tablet_bootstrap.cc:654] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:06.054039 3211 tablet_bootstrap.cc:654] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:06.054366 3210 log.cc:824] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:06.054438 3211 log.cc:824] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:06.055156 3211 tablet_bootstrap.cc:492] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40: No bootstrap required, opened a new log
I20260812 06:13:06.055253 3211 ts_tablet_manager.cc:1397] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:13:06.055799 3210 tablet_bootstrap.cc:492] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279: No bootstrap required, opened a new log
I20260812 06:13:06.055824 3215 tablet_bootstrap.cc:492] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77: Bootstrap starting.
I20260812 06:13:06.055928 3210 ts_tablet_manager.cc:1397] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:13:06.056587 3215 tablet_bootstrap.cc:654] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:06.056979 3215 log.cc:824] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:06.057475 3211 raft_consensus.cc:348] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.057687 3211 raft_consensus.cc:374] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:06.057729 3211 raft_consensus.cc:729] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d0a4ff01944df9bc8ca8a10ee38b40, State: Initialized, Role: FOLLOWER
I20260812 06:13:06.057874 3215 tablet_bootstrap.cc:492] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77: No bootstrap required, opened a new log
I20260812 06:13:06.057767 3210 raft_consensus.cc:348] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.057868 3211 consensus_queue.cc:260] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.057922 3210 raft_consensus.cc:374] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:06.057938 3215 ts_tablet_manager.cc:1397] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:13:06.057962 3210 raft_consensus.cc:729] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9879cda1e93048079830f378368e7279, State: Initialized, Role: FOLLOWER
I20260812 06:13:06.058092 3210 consensus_queue.cc:260] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.058163 3211 ts_tablet_manager.cc:1428] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:13:06.058310 2746 heartbeater.cc:503] Master 127.0.176.254:38001 was elected leader, sending a full tablet report...
I20260812 06:13:06.058384 3210 ts_tablet_manager.cc:1428] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:13:06.058528 2956 heartbeater.cc:503] Master 127.0.176.254:38001 was elected leader, sending a full tablet report...
I20260812 06:13:06.060077 3215 raft_consensus.cc:348] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.060215 3215 raft_consensus.cc:374] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:06.060238 3215 raft_consensus.cc:729] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c97e8e23dac4345b2e405e64e30ea77, State: Initialized, Role: FOLLOWER
I20260812 06:13:06.060329 3215 consensus_queue.cc:260] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.060601 3215 ts_tablet_manager.cc:1428] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:13:06.060644 3170 heartbeater.cc:503] Master 127.0.176.254:38001 was elected leader, sending a full tablet report...
W20260812 06:13:06.077805 2957 tablet.cc:2369] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:13:06.161049 2747 tablet.cc:2369] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:13:06.235261 3221 raft_consensus.cc:482] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:06.235467 3221 raft_consensus.cc:504] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.235890 3217 raft_consensus.cc:482] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:06.235913 3221 leader_election.cc:288] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9879cda1e93048079830f378368e7279 (127.0.176.194:36877), f6d0a4ff01944df9bc8ca8a10ee38b40 (127.0.176.193:35309)
I20260812 06:13:06.236027 3217 raft_consensus.cc:504] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.236411 3217 leader_election.cc:288] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9879cda1e93048079830f378368e7279 (127.0.176.194:36877), 2c97e8e23dac4345b2e405e64e30ea77 (127.0.176.195:38443)
I20260812 06:13:06.240047 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.236159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:36877 (local address 127.0.176.195:50797)
0812 06:13:06.236225 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:06.236239 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:06.236291 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:06.236548 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:06.236549 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:06.236552 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:06.236640 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.236642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.237676 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.237677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.238984 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.238988 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.239768 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.239769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.239866 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.239870 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.239916 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.239956 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":18}
I20260812 06:13:06.240458 3209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.236640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:41883 (local address 127.0.176.193:35309)
0812 06:13:06.236685 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.236687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.236696 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:06.236722 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.236723 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.236732 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.236785 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:06.237055 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.237752 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.239506 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.240004 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.240043 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.240050 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.240313 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.240358 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:13:06.240465 3205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.236833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:38879 (local address 127.0.176.195:38443)
0812 06:13:06.236869 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.236871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.237130 (+ 259us) server_negotiation.cc:407] Connection header received
0812 06:13:06.237274 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.237275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.237297 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.237328 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:06.237527 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.238220 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.239596 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.240104 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.240147 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.240155 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.240364 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.240401 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:13:06.240485 3223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.236557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:36877 (local address 127.0.176.193:55539)
0812 06:13:06.236873 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:06.236882 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:06.236929 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:06.237115 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:06.237116 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:06.237118 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:06.237176 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.237179 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.238122 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.238123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.239342 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.239344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.240196 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.240197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.240265 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.240269 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.240328 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.240374 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":57,"threads_started":1}
I20260812 06:13:06.240525 3204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.236295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:50797 (local address 127.0.176.194:36877)
0812 06:13:06.236345 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.236347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.236359 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:13:06.236391 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.236392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.236403 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.236482 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:06.236742 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.237555 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.239100 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.239658 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.239729 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.239739 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.240403 (+ 664us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.240447 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:13:06.240688 3222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.236270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:35309 (local address 127.0.176.195:41883)
0812 06:13:06.236442 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:06.236452 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:06.236495 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:06.236836 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:06.236837 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:06.236839 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:06.236929 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.236931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.237870 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.237871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.239415 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.239418 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.240126 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.240127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.240205 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.240208 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.240396 (+ 188us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.240574 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":115,"threads_started":1}
I20260812 06:13:06.240698 3225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.236648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:55539 (local address 127.0.176.194:36877)
0812 06:13:06.236933 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.236935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.236961 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:13:06.236985 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.236986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.237006 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.237069 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:06.237253 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.238034 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.239485 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.240087 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.240155 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.240162 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.240563 (+ 401us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.240612 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":83,"threads_started":1}
I20260812 06:13:06.240798 3228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.236729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:38443 (local address 127.0.176.193:38879)
0812 06:13:06.237076 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:06.237086 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:06.237154 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:06.237385 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:06.237386 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:06.237387 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:06.237437 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.237439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.238366 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.238366 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.239513 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.239515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.240211 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.240211 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.240270 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.240273 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.240678 (+ 405us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.240722 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":76,"threads_started":1}
I20260812 06:13:06.240970 2886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "143a5bbf2c4a4fdfb44493b526505847" candidate_uuid: "2c97e8e23dac4345b2e405e64e30ea77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9879cda1e93048079830f378368e7279" is_pre_election: true
I20260812 06:13:06.241146 2886 raft_consensus.cc:2454] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c97e8e23dac4345b2e405e64e30ea77 in term 0.
I20260812 06:13:06.241156 2892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "143a5bbf2c4a4fdfb44493b526505847" candidate_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9879cda1e93048079830f378368e7279" is_pre_election: true
I20260812 06:13:06.241302 2892 raft_consensus.cc:2454] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d0a4ff01944df9bc8ca8a10ee38b40 in term 0.
I20260812 06:13:06.241297 2666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "143a5bbf2c4a4fdfb44493b526505847" candidate_uuid: "2c97e8e23dac4345b2e405e64e30ea77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" is_pre_election: true
I20260812 06:13:06.241400 2666 raft_consensus.cc:2454] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c97e8e23dac4345b2e405e64e30ea77 in term 0.
I20260812 06:13:06.241423 2994 leader_election.cc:302] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c97e8e23dac4345b2e405e64e30ea77, 9879cda1e93048079830f378368e7279; no voters:
I20260812 06:13:06.241494 2561 leader_election.cc:302] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9879cda1e93048079830f378368e7279, f6d0a4ff01944df9bc8ca8a10ee38b40; no voters:
I20260812 06:13:06.241493 3102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "143a5bbf2c4a4fdfb44493b526505847" candidate_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c97e8e23dac4345b2e405e64e30ea77" is_pre_election: true
I20260812 06:13:06.241549 3221 raft_consensus.cc:2781] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:06.241621 3102 raft_consensus.cc:2454] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d0a4ff01944df9bc8ca8a10ee38b40 in term 0.
I20260812 06:13:06.241621 3217 raft_consensus.cc:2781] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:06.241663 3217 raft_consensus.cc:482] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:06.241662 3221 raft_consensus.cc:482] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:06.241688 3217 raft_consensus.cc:3037] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:06.241693 3221 raft_consensus.cc:3037] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:06.242621 3221 raft_consensus.cc:504] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.242621 3217 raft_consensus.cc:504] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.242774 3221 leader_election.cc:288] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [CANDIDATE]: Term 1 election: Requested vote from peers 9879cda1e93048079830f378368e7279 (127.0.176.194:36877), f6d0a4ff01944df9bc8ca8a10ee38b40 (127.0.176.193:35309)
I20260812 06:13:06.242790 3217 leader_election.cc:288] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [CANDIDATE]: Term 1 election: Requested vote from peers 9879cda1e93048079830f378368e7279 (127.0.176.194:36877), 2c97e8e23dac4345b2e405e64e30ea77 (127.0.176.195:38443)
I20260812 06:13:06.243000 3102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "143a5bbf2c4a4fdfb44493b526505847" candidate_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c97e8e23dac4345b2e405e64e30ea77"
I20260812 06:13:06.243042 2892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "143a5bbf2c4a4fdfb44493b526505847" candidate_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9879cda1e93048079830f378368e7279"
I20260812 06:13:06.243053 2666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "143a5bbf2c4a4fdfb44493b526505847" candidate_uuid: "2c97e8e23dac4345b2e405e64e30ea77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40"
I20260812 06:13:06.243103 3102 raft_consensus.cc:2379] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f6d0a4ff01944df9bc8ca8a10ee38b40 in current term 1: Already voted for candidate 2c97e8e23dac4345b2e405e64e30ea77 in this term.
I20260812 06:13:06.243076 2886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "143a5bbf2c4a4fdfb44493b526505847" candidate_uuid: "2c97e8e23dac4345b2e405e64e30ea77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9879cda1e93048079830f378368e7279"
I20260812 06:13:06.243145 2666 raft_consensus.cc:2379] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c97e8e23dac4345b2e405e64e30ea77 in current term 1: Already voted for candidate f6d0a4ff01944df9bc8ca8a10ee38b40 in this term.
I20260812 06:13:06.243126 2892 raft_consensus.cc:3037] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:06.243463 2994 leader_election.cc:302] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c97e8e23dac4345b2e405e64e30ea77; no voters: 9879cda1e93048079830f378368e7279, f6d0a4ff01944df9bc8ca8a10ee38b40
I20260812 06:13:06.243588 3221 raft_consensus.cc:2726] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 06:13:06.244091 2892 raft_consensus.cc:2454] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d0a4ff01944df9bc8ca8a10ee38b40 in term 1.
I20260812 06:13:06.244336 2561 leader_election.cc:302] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9879cda1e93048079830f378368e7279, f6d0a4ff01944df9bc8ca8a10ee38b40; no voters: 2c97e8e23dac4345b2e405e64e30ea77
W20260812 06:13:06.244357 3172 tablet.cc:2369] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:13:06.244462 3217 raft_consensus.cc:2781] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:06.244616 3217 raft_consensus.cc:686] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 1 LEADER]: Becoming Leader. State: Replica: f6d0a4ff01944df9bc8ca8a10ee38b40, State: Running, Role: LEADER
I20260812 06:13:06.244726 3217 consensus_queue.cc:237] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.245620 2405 catalog_manager.cc:5495] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6d0a4ff01944df9bc8ca8a10ee38b40 (127.0.176.193). New cstate: current_term: 1 leader_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } health_report { overall_health: UNKNOWN } } }
I20260812 06:13:06.277032 3209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.274362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59858 (local address 127.0.176.193:35309)
0812 06:13:06.274472 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.274474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.274483 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:06.274522 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.274523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.274543 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.274624 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:06.274813 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.275307 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.276146 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.276343 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.276426 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.276654 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:06.276767 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:06.276862 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.276911 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.276934 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 06:13:06.278983 2892 raft_consensus.cc:1261] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279 [term 1 FOLLOWER]: Refusing update from remote peer f6d0a4ff01944df9bc8ca8a10ee38b40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:06.278985 3102 raft_consensus.cc:1261] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 1 FOLLOWER]: Refusing update from remote peer f6d0a4ff01944df9bc8ca8a10ee38b40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:06.279296 3217 consensus_queue.cc:1035] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:06.279511 3229 consensus_queue.cc:1035] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:06.283082 3237 mvcc.cc:205] Tried to move back new op lower bound from 7317566202995896320 to 7317566202859069440. Current Snapshot: MvccSnapshot[applied={T|T < 7317566202995896320 or (T in {7317566202995896320})}]
I20260812 06:13:06.283339 3236 mvcc.cc:205] Tried to move back new op lower bound from 7317566202995896320 to 7317566202859069440. Current Snapshot: MvccSnapshot[applied={T|T < 7317566202995896320}]
I20260812 06:13:06.286571 2404 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:06.286748 2404 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:06.287778 2404 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba: Sending DeleteTablet for 3 replicas of tablet 143a5bbf2c4a4fdfb44493b526505847
I20260812 06:13:06.288427 3073 tablet_service.cc:1514] Processing DeleteTablet for tablet 143a5bbf2c4a4fdfb44493b526505847 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:06 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:47682
I20260812 06:13:06.288436 2856 tablet_service.cc:1514] Processing DeleteTablet for tablet 143a5bbf2c4a4fdfb44493b526505847 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:06 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:44588
I20260812 06:13:06.288436 2637 tablet_service.cc:1514] Processing DeleteTablet for tablet 143a5bbf2c4a4fdfb44493b526505847 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:06 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:59854
I20260812 06:13:06.288856 3255 tablet_replica.cc:330] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279: stopping tablet replica
I20260812 06:13:06.288995 3255 raft_consensus.cc:2229] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:06.289140 3255 raft_consensus.cc:2258] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:06.289355 3257 tablet_replica.cc:330] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40: stopping tablet replica
I20260812 06:13:06.289278 2404 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:13:06.289467 2404 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:06.289705 3257 raft_consensus.cc:2229] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:13:06.289738 3255 ts_tablet_manager.cc:1905] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:06.289947 3257 raft_consensus.cc:2258] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:06.290545 3257 ts_tablet_manager.cc:1905] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:06.291244 2856 tablet_service.cc:1467] Processing CreateTablet for tablet 2726d65870514afe967f6aa635609f99 (DEFAULT_TABLE table=test-table [id=df92f3866d61425da48988872b83ef66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:06.291332 3073 tablet_service.cc:1467] Processing CreateTablet for tablet 2726d65870514afe967f6aa635609f99 (DEFAULT_TABLE table=test-table [id=df92f3866d61425da48988872b83ef66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:06.291426 2856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2726d65870514afe967f6aa635609f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:06.291491 3073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2726d65870514afe967f6aa635609f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:06.292415 3255 ts_tablet_manager.cc:1918] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:06.292492 3255 log.cc:1196] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/143a5bbf2c4a4fdfb44493b526505847
I20260812 06:13:06.292773 3255 ts_tablet_manager.cc:1939] T 143a5bbf2c4a4fdfb44493b526505847 P 9879cda1e93048079830f378368e7279: Deleting consensus metadata
I20260812 06:13:06.292891 3210 tablet_bootstrap.cc:492] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279: Bootstrap starting.
I20260812 06:13:06.292984 3215 tablet_bootstrap.cc:492] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77: Bootstrap starting.
I20260812 06:13:06.293404 3210 tablet_bootstrap.cc:654] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:06.293490 3215 tablet_bootstrap.cc:654] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:06.294147 3210 tablet_bootstrap.cc:492] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279: No bootstrap required, opened a new log
I20260812 06:13:06.294204 3210 ts_tablet_manager.cc:1397] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:06.294260 3215 tablet_bootstrap.cc:492] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77: No bootstrap required, opened a new log
I20260812 06:13:06.294322 3215 ts_tablet_manager.cc:1397] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:06.294245 2379 catalog_manager.cc:4841] TS 9879cda1e93048079830f378368e7279 (127.0.176.194:36877): tablet 143a5bbf2c4a4fdfb44493b526505847 (table test-table [id=a2fb2b431a744a4b8c58ec33572d43e2]) successfully deleted
I20260812 06:13:06.294435 3210 raft_consensus.cc:348] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.294529 3210 raft_consensus.cc:374] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:06.294492 3215 raft_consensus.cc:348] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.294553 3210 raft_consensus.cc:729] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9879cda1e93048079830f378368e7279, State: Initialized, Role: FOLLOWER
I20260812 06:13:06.294566 3215 raft_consensus.cc:374] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:06.294589 3215 raft_consensus.cc:729] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c97e8e23dac4345b2e405e64e30ea77, State: Initialized, Role: FOLLOWER
I20260812 06:13:06.294607 3210 consensus_queue.cc:260] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.294646 3215 consensus_queue.cc:260] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.294716 3210 ts_tablet_manager.cc:1428] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 06:13:06.294751 3215 ts_tablet_manager.cc:1428] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 06:13:06.294880 2637 tablet_service.cc:1467] Processing CreateTablet for tablet 2726d65870514afe967f6aa635609f99 (DEFAULT_TABLE table=test-table [id=df92f3866d61425da48988872b83ef66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:06.295025 2637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2726d65870514afe967f6aa635609f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:06.296279 3211 tablet_bootstrap.cc:492] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40: Bootstrap starting.
I20260812 06:13:06.296530 3254 tablet_replica.cc:330] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77: stopping tablet replica
I20260812 06:13:06.296685 3254 raft_consensus.cc:2229] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:06.296806 3211 tablet_bootstrap.cc:654] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:06.296839 3254 raft_consensus.cc:2258] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:06.297899 3254 ts_tablet_manager.cc:1905] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:06.298628 3257 ts_tablet_manager.cc:1918] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:06.298738 3257 log.cc:1196] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/wal/wals/143a5bbf2c4a4fdfb44493b526505847
I20260812 06:13:06.299094 3257 ts_tablet_manager.cc:1939] T 143a5bbf2c4a4fdfb44493b526505847 P f6d0a4ff01944df9bc8ca8a10ee38b40: Deleting consensus metadata
I20260812 06:13:06.299638 2379 catalog_manager.cc:4841] TS f6d0a4ff01944df9bc8ca8a10ee38b40 (127.0.176.193:35309): tablet 143a5bbf2c4a4fdfb44493b526505847 (table test-table [id=a2fb2b431a744a4b8c58ec33572d43e2]) successfully deleted
I20260812 06:13:06.299886 3211 tablet_bootstrap.cc:492] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40: No bootstrap required, opened a new log
I20260812 06:13:06.299950 3211 ts_tablet_manager.cc:1397] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260812 06:13:06.300061 3254 ts_tablet_manager.cc:1918] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:06.300129 3254 log.cc:1196] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/143a5bbf2c4a4fdfb44493b526505847
I20260812 06:13:06.300119 3211 raft_consensus.cc:348] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.300227 3211 raft_consensus.cc:374] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:06.300257 3211 raft_consensus.cc:729] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d0a4ff01944df9bc8ca8a10ee38b40, State: Initialized, Role: FOLLOWER
I20260812 06:13:06.300316 3211 consensus_queue.cc:260] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.300426 3211 ts_tablet_manager.cc:1428] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:06.300566 3254 ts_tablet_manager.cc:1939] T 143a5bbf2c4a4fdfb44493b526505847 P 2c97e8e23dac4345b2e405e64e30ea77: Deleting consensus metadata
I20260812 06:13:06.301076 2383 catalog_manager.cc:4841] TS 2c97e8e23dac4345b2e405e64e30ea77 (127.0.176.195:38443): tablet 143a5bbf2c4a4fdfb44493b526505847 (table test-table [id=a2fb2b431a744a4b8c58ec33572d43e2]) successfully deleted
I20260812 06:13:06.567948 3219 raft_consensus.cc:482] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:06.568065 3219 raft_consensus.cc:504] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.568385 3219 leader_election.cc:288] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6d0a4ff01944df9bc8ca8a10ee38b40 (127.0.176.193:35309), 2c97e8e23dac4345b2e405e64e30ea77 (127.0.176.195:38443)
I20260812 06:13:06.571777 3209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.568710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:37143 (local address 127.0.176.193:35309)
0812 06:13:06.568763 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.568766 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.568928 (+ 162us) server_negotiation.cc:407] Connection header received
0812 06:13:06.569046 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.569047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.569061 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.569139 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:06.569313 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.569946 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.570992 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.571362 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.571489 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.571498 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.571655 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.571695 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:13:06.571802 3262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.568620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:35309 (local address 127.0.176.194:37143)
0812 06:13:06.568843 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:06.568854 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:06.568951 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:06.569143 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:06.569144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:06.569148 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:06.569236 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.569238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.570052 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.570053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.570898 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.570901 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.571490 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.571491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.571566 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.571570 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.571646 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.571694 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":11,"thread_start_us":95,"threads_started":1}
I20260812 06:13:06.571856 3205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.568720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:37201 (local address 127.0.176.195:38443)
0812 06:13:06.568782 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.568784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.568976 (+ 192us) server_negotiation.cc:407] Connection header received
0812 06:13:06.569051 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.569052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.569061 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.569146 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:06.569314 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.569924 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.570956 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.571332 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.571437 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.571448 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.571726 (+ 278us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.571771 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:13:06.571899 3263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.568621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:38443 (local address 127.0.176.194:37201)
0812 06:13:06.568885 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:06.568896 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:06.568990 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:06.569153 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:06.569153 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:06.569156 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:06.569240 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.569241 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.570016 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.570017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.570852 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.570854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.571451 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.571453 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.571533 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.571537 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.571715 (+ 178us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.571771 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":149,"thread_start_us":46,"threads_started":1}
I20260812 06:13:06.572221 3102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2726d65870514afe967f6aa635609f99" candidate_uuid: "9879cda1e93048079830f378368e7279" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c97e8e23dac4345b2e405e64e30ea77" is_pre_election: true
I20260812 06:13:06.572253 2666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2726d65870514afe967f6aa635609f99" candidate_uuid: "9879cda1e93048079830f378368e7279" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" is_pre_election: true
I20260812 06:13:06.572331 3102 raft_consensus.cc:2454] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9879cda1e93048079830f378368e7279 in term 0.
I20260812 06:13:06.572371 2666 raft_consensus.cc:2454] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9879cda1e93048079830f378368e7279 in term 0.
I20260812 06:13:06.572530 2783 leader_election.cc:302] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c97e8e23dac4345b2e405e64e30ea77, 9879cda1e93048079830f378368e7279; no voters:
I20260812 06:13:06.572749 3219 raft_consensus.cc:2781] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:06.572793 3219 raft_consensus.cc:482] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:06.572808 3219 raft_consensus.cc:3037] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:06.573557 3219 raft_consensus.cc:504] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.573716 3219 leader_election.cc:288] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [CANDIDATE]: Term 1 election: Requested vote from peers f6d0a4ff01944df9bc8ca8a10ee38b40 (127.0.176.193:35309), 2c97e8e23dac4345b2e405e64e30ea77 (127.0.176.195:38443)
I20260812 06:13:06.573887 2666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2726d65870514afe967f6aa635609f99" candidate_uuid: "9879cda1e93048079830f378368e7279" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40"
I20260812 06:13:06.573992 2666 raft_consensus.cc:3037] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:06.573963 3102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2726d65870514afe967f6aa635609f99" candidate_uuid: "9879cda1e93048079830f378368e7279" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c97e8e23dac4345b2e405e64e30ea77"
I20260812 06:13:06.574031 3102 raft_consensus.cc:3037] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:06.574832 3102 raft_consensus.cc:2454] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9879cda1e93048079830f378368e7279 in term 1.
I20260812 06:13:06.574875 2666 raft_consensus.cc:2454] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9879cda1e93048079830f378368e7279 in term 1.
I20260812 06:13:06.575054 2780 leader_election.cc:302] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9879cda1e93048079830f378368e7279, f6d0a4ff01944df9bc8ca8a10ee38b40; no voters:
I20260812 06:13:06.575169 3219 raft_consensus.cc:2781] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:06.575304 3219 raft_consensus.cc:686] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [term 1 LEADER]: Becoming Leader. State: Replica: 9879cda1e93048079830f378368e7279, State: Running, Role: LEADER
I20260812 06:13:06.575420 3219 consensus_queue.cc:237] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.576161 2405 catalog_manager.cc:5495] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9879cda1e93048079830f378368e7279 (127.0.176.194). New cstate: current_term: 1 leader_uuid: "9879cda1e93048079830f378368e7279" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } health_report { overall_health: UNKNOWN } } }
Aug 12 06:13:06 dist-test-slave-gw5c krb5kdc[2339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515185, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:06.612339 3276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.604410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34124 (local address 127.0.176.254:38001)
0812 06:13:06.604568 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.604570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.604582 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:13:06.604611 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.604611 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.604622 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.604720 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:06.605254 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.605800 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.606573 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.606783 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.606841 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.609432 (+ 2591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:06.609433 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:06.609434 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:06.609441 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:06.610969 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:06.611459 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:06.611460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:06.611460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:06.611525 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:06.611733 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:06.611734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:06.611735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:06.611857 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:06.611936 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.612095 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.612216 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":76,"threads_started":1}
I20260812 06:13:06.612416 3275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.604242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:38001 (local address 127.0.0.1:34124)
0812 06:13:06.604482 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:06.604496 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:06.604563 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:06.604758 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:06.604759 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:06.605086 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:06.605142 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.605145 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.605882 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.605882 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.606489 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.606491 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.606882 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.606883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.606933 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.607665 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:06.607671 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:06.609328 (+ 1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:06.611100 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:06.611111 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:06.611113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:06.611339 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:06.611594 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:06.611595 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:06.611595 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:06.611662 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:06.611926 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:06.611934 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:06.611982 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.612071 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.612286 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":102,"thread_start_us":117,"threads_started":1}
I20260812 06:13:06.614701 2405 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:34124:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 06:13:06.615000 2405 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:06.616791 2856 tablet_service.cc:1467] Processing CreateTablet for tablet 97fa01310a2e43788977655fcd6dc600 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=39d4aeb2fff3428b8640d6fa1ea7820c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:13:06.616740 2637 tablet_service.cc:1467] Processing CreateTablet for tablet 97fa01310a2e43788977655fcd6dc600 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=39d4aeb2fff3428b8640d6fa1ea7820c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:13:06.616986 2637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97fa01310a2e43788977655fcd6dc600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:06.616986 2856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97fa01310a2e43788977655fcd6dc600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:06.618201 3211 tablet_bootstrap.cc:492] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40: Bootstrap starting.
I20260812 06:13:06.616740 3073 tablet_service.cc:1467] Processing CreateTablet for tablet 97fa01310a2e43788977655fcd6dc600 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=39d4aeb2fff3428b8640d6fa1ea7820c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:13:06.618431 3073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97fa01310a2e43788977655fcd6dc600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:06.618503 3211 tablet_bootstrap.cc:654] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:06.619102 3211 tablet_bootstrap.cc:492] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40: No bootstrap required, opened a new log
I20260812 06:13:06.619163 3211 ts_tablet_manager.cc:1397] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:06.619284 3211 raft_consensus.cc:348] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.619374 3211 raft_consensus.cc:374] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:06.619436 3211 raft_consensus.cc:729] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d0a4ff01944df9bc8ca8a10ee38b40, State: Initialized, Role: FOLLOWER
I20260812 06:13:06.619494 3211 consensus_queue.cc:260] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.619618 3211 ts_tablet_manager.cc:1428] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:06.620083 3210 tablet_bootstrap.cc:492] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279: Bootstrap starting.
I20260812 06:13:06.620141 3247 tablet_replica.cc:439] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } } }
I20260812 06:13:06.620245 3247 tablet_replica.cc:442] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:06.620359 3215 tablet_bootstrap.cc:492] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77: Bootstrap starting.
I20260812 06:13:06.620587 3210 tablet_bootstrap.cc:654] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:06.620724 3215 tablet_bootstrap.cc:654] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:06.621369 3210 tablet_bootstrap.cc:492] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279: No bootstrap required, opened a new log
I20260812 06:13:06.621429 3210 ts_tablet_manager.cc:1397] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:06.621548 3215 tablet_bootstrap.cc:492] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77: No bootstrap required, opened a new log
I20260812 06:13:06.621611 3215 ts_tablet_manager.cc:1397] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:06.621574 3210 raft_consensus.cc:348] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.621656 3210 raft_consensus.cc:374] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:06.621670 3210 raft_consensus.cc:729] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9879cda1e93048079830f378368e7279, State: Initialized, Role: FOLLOWER
I20260812 06:13:06.621729 3210 consensus_queue.cc:260] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.621764 3215 raft_consensus.cc:348] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.621836 3215 raft_consensus.cc:374] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:06.621856 3215 raft_consensus.cc:729] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c97e8e23dac4345b2e405e64e30ea77, State: Initialized, Role: FOLLOWER
I20260812 06:13:06.621847 3210 ts_tablet_manager.cc:1428] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:06.621896 3215 consensus_queue.cc:260] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.621886 3219 tablet_replica.cc:439] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } } }
I20260812 06:13:06.621974 3219 tablet_replica.cc:442] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:06.621992 3215 ts_tablet_manager.cc:1428] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 06:13:06.622259 3221 tablet_replica.cc:439] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } } }
I20260812 06:13:06.622356 3221 tablet_replica.cc:442] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:06.793788 3221 raft_consensus.cc:482] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:06.793913 3221 raft_consensus.cc:504] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.794098 3221 leader_election.cc:288] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6d0a4ff01944df9bc8ca8a10ee38b40 (127.0.176.193:35309), 9879cda1e93048079830f378368e7279 (127.0.176.194:36877)
I20260812 06:13:06.794387 2666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97fa01310a2e43788977655fcd6dc600" candidate_uuid: "2c97e8e23dac4345b2e405e64e30ea77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" is_pre_election: true
I20260812 06:13:06.794428 2892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97fa01310a2e43788977655fcd6dc600" candidate_uuid: "2c97e8e23dac4345b2e405e64e30ea77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9879cda1e93048079830f378368e7279" is_pre_election: true
I20260812 06:13:06.794500 2666 raft_consensus.cc:2454] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c97e8e23dac4345b2e405e64e30ea77 in term 0.
I20260812 06:13:06.794538 2892 raft_consensus.cc:2454] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c97e8e23dac4345b2e405e64e30ea77 in term 0.
I20260812 06:13:06.794708 2994 leader_election.cc:302] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c97e8e23dac4345b2e405e64e30ea77, f6d0a4ff01944df9bc8ca8a10ee38b40; no voters:
I20260812 06:13:06.794811 3221 raft_consensus.cc:2781] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:06.794855 3221 raft_consensus.cc:482] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:06.794907 3221 raft_consensus.cc:3037] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:06.795729 3221 raft_consensus.cc:504] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.795897 3221 leader_election.cc:288] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [CANDIDATE]: Term 1 election: Requested vote from peers f6d0a4ff01944df9bc8ca8a10ee38b40 (127.0.176.193:35309), 9879cda1e93048079830f378368e7279 (127.0.176.194:36877)
I20260812 06:13:06.796097 2666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97fa01310a2e43788977655fcd6dc600" candidate_uuid: "2c97e8e23dac4345b2e405e64e30ea77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40"
I20260812 06:13:06.796177 2666 raft_consensus.cc:3037] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:06.796115 2892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97fa01310a2e43788977655fcd6dc600" candidate_uuid: "2c97e8e23dac4345b2e405e64e30ea77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9879cda1e93048079830f378368e7279"
I20260812 06:13:06.796222 2892 raft_consensus.cc:3037] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:06.796869 2666 raft_consensus.cc:2454] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c97e8e23dac4345b2e405e64e30ea77 in term 1.
I20260812 06:13:06.796918 2892 raft_consensus.cc:2454] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c97e8e23dac4345b2e405e64e30ea77 in term 1.
I20260812 06:13:06.797089 2994 leader_election.cc:302] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c97e8e23dac4345b2e405e64e30ea77, 9879cda1e93048079830f378368e7279; no voters:
I20260812 06:13:06.797196 3221 raft_consensus.cc:2781] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:06.797336 3221 raft_consensus.cc:686] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [term 1 LEADER]: Becoming Leader. State: Replica: 2c97e8e23dac4345b2e405e64e30ea77, State: Running, Role: LEADER
I20260812 06:13:06.797441 3221 consensus_queue.cc:237] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } }
I20260812 06:13:06.797722 3283 tablet_replica.cc:439] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77: TxnStatusTablet state changed. Reason: New leader 2c97e8e23dac4345b2e405e64e30ea77. Latest consensus state: current_term: 1 leader_uuid: "2c97e8e23dac4345b2e405e64e30ea77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } } }
I20260812 06:13:06.797820 3283 tablet_replica.cc:442] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:13:06.797962 3285 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:13:06.798097 3285 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 06:13:06.798214 2405 catalog_manager.cc:5495] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c97e8e23dac4345b2e405e64e30ea77 (127.0.176.195). New cstate: current_term: 1 leader_uuid: "2c97e8e23dac4345b2e405e64e30ea77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } health_report { overall_health: HEALTHY } } }
I20260812 06:13:06.808140 3275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.805254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:38443 (local address 127.0.0.1:47688)
0812 06:13:06.805335 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:06.805349 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:06.805402 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:06.805581 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:06.805582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:06.805583 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:13:06.805648 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.805651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.806553 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.806554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.807141 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.807144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.807647 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.807648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.807710 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.807727 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:13:06.808008 (+ 281us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:13:06.808011 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.808037 (+ 26us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.808077 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 06:13:06.808154 3205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.805331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47688 (local address 127.0.176.195:38443)
0812 06:13:06.805381 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.805383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.805394 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:06.805478 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.805479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.805500 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.805582 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:06.805711 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.806463 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.807232 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.807568 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.807648 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.807816 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:06.807942 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:06.808027 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.808046 (+ 19us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.808066 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:13:06.809719 2892 raft_consensus.cc:1261] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279 [term 1 FOLLOWER]: Refusing update from remote peer 2c97e8e23dac4345b2e405e64e30ea77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:06.809733 2666 raft_consensus.cc:1261] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 1 FOLLOWER]: Refusing update from remote peer 2c97e8e23dac4345b2e405e64e30ea77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:06.810038 3283 consensus_queue.cc:1035] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:06.810189 3221 consensus_queue.cc:1035] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:06.810901 3219 tablet_replica.cc:439] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279: TxnStatusTablet state changed. Reason: New leader 2c97e8e23dac4345b2e405e64e30ea77. Latest consensus state: current_term: 1 leader_uuid: "2c97e8e23dac4345b2e405e64e30ea77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } } }
I20260812 06:13:06.811002 3219 tablet_replica.cc:442] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:06.810981 3247 tablet_replica.cc:439] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40: TxnStatusTablet state changed. Reason: New leader 2c97e8e23dac4345b2e405e64e30ea77. Latest consensus state: current_term: 1 leader_uuid: "2c97e8e23dac4345b2e405e64e30ea77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } } }
I20260812 06:13:06.811084 3247 tablet_replica.cc:442] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:06.812201 3221 tablet_replica.cc:439] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2c97e8e23dac4345b2e405e64e30ea77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } } }
I20260812 06:13:06.812292 3221 tablet_replica.cc:442] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:13:06.812494 3219 tablet_replica.cc:439] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2c97e8e23dac4345b2e405e64e30ea77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } } }
I20260812 06:13:06.812574 3219 tablet_replica.cc:442] T 97fa01310a2e43788977655fcd6dc600 P 9879cda1e93048079830f378368e7279: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:06.813190 3247 tablet_replica.cc:439] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2c97e8e23dac4345b2e405e64e30ea77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } } }
I20260812 06:13:06.813271 3247 tablet_replica.cc:442] T 97fa01310a2e43788977655fcd6dc600 P f6d0a4ff01944df9bc8ca8a10ee38b40: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:06.813551 3296 mvcc.cc:205] Tried to move back new op lower bound from 7317566205170282496 to 7317566205122940928. Current Snapshot: MvccSnapshot[applied={T|T < 7317566205170282496 or (T in {7317566205170282496})}]
I20260812 06:13:06.813844 3283 tablet_replica.cc:439] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2c97e8e23dac4345b2e405e64e30ea77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 } } peers { permanent_uuid: "9879cda1e93048079830f378368e7279" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 36877 } } peers { permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 } } }
I20260812 06:13:06.814023 3283 tablet_replica.cc:442] T 97fa01310a2e43788977655fcd6dc600 P 2c97e8e23dac4345b2e405e64e30ea77: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:13:06.818146 3312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.815363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44602 (local address 127.0.176.194:36877)
0812 06:13:06.815474 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.815476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.815485 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:06.815573 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.815573 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.815591 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.815653 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:06.815795 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.816269 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.817355 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.817555 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.817614 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.817784 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:06.817884 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:06.817939 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.818015 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.818032 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":70,"threads_started":1}
I20260812 06:13:06.823369 3205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.821043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:40259 (local address 127.0.176.195:38443)
0812 06:13:06.821106 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.821108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.821115 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:13:06.821134 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.821135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.821144 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.821209 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:06.821341 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.821808 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.822627 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.822872 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.822949 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.823116 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:06.823158 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:06.823221 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.823273 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.823299 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 06:13:06.823467 3316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.820690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:38443 (local address 127.0.176.194:40259)
0812 06:13:06.820838 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:06.820848 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:06.820900 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:06.821213 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:06.821214 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:06.821216 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:13:06.821267 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.821268 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.821890 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.821891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.822512 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.822515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.822948 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.822949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.823015 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.823030 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:13:06.823222 (+ 192us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:13:06.823225 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.823272 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.823330 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260812 06:13:06.826778 2666 raft_consensus.cc:1261] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 1 FOLLOWER]: Refusing update from remote peer 9879cda1e93048079830f378368e7279: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:06.827255 3264 consensus_queue.cc:1035] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d0a4ff01944df9bc8ca8a10ee38b40" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:06.829607 3102 raft_consensus.cc:1261] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77 [term 1 FOLLOWER]: Refusing update from remote peer 9879cda1e93048079830f378368e7279: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:06.830498 3219 consensus_queue.cc:1035] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c97e8e23dac4345b2e405e64e30ea77" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 38443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:06.839946 3312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.836539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:56933 (local address 127.0.176.194:36877)
0812 06:13:06.836711 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.836713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.836878 (+ 165us) server_negotiation.cc:407] Connection header received
0812 06:13:06.836910 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.836911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.836942 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.837004 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:06.837179 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.837961 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.838882 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.839204 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.839277 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.839655 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:06.839694 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:06.839744 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.839840 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.839864 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144}
I20260812 06:13:06.839980 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.836471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:36877 (local address 127.0.176.195:56933)
0812 06:13:06.836802 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:06.836814 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:06.836869 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:06.837018 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:06.837019 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:06.837020 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:13:06.837105 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.837107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.838030 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.838031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.838802 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:06.838805 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.839316 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.839317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:06.839427 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.839445 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:13:06.839770 (+ 325us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:13:06.839772 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:13:06.839833 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:13:06.839881 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":205,"threads_started":1}
I20260812 06:13:06.851840 2405 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:06.851981 2405 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:06.852648 2405 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b6f661bcee34f80a42992b67620d5ba: Sending DeleteTablet for 3 replicas of tablet 2726d65870514afe967f6aa635609f99
I20260812 06:13:06.852958 2637 tablet_service.cc:1514] Processing DeleteTablet for tablet 2726d65870514afe967f6aa635609f99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:06 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:59854
I20260812 06:13:06.853032 3073 tablet_service.cc:1514] Processing DeleteTablet for tablet 2726d65870514afe967f6aa635609f99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:06 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:47682
I20260812 06:13:06.853070 2856 tablet_service.cc:1514] Processing DeleteTablet for tablet 2726d65870514afe967f6aa635609f99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:06 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:44588
I20260812 06:13:06.855516 3327 tablet_replica.cc:330] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40: stopping tablet replica
I20260812 06:13:06.855669 3327 raft_consensus.cc:2229] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:06.855779 3327 raft_consensus.cc:2258] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:06.856149 3327 ts_tablet_manager.cc:1905] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:06.858276 3327 ts_tablet_manager.cc:1918] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:06.858497 3331 tablet_replica.cc:330] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279: stopping tablet replica
I20260812 06:13:06.858613 3331 raft_consensus.cc:2229] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:13:06.858793 3331 raft_consensus.cc:2258] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:06.859212 3331 ts_tablet_manager.cc:1905] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 06:13:06 dist-test-slave-gw5c krb5kdc[2339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515186, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.176.193@KRBTEST.COM
I20260812 06:13:06.860553 3327 log.cc:1196] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-0/wal/wals/2726d65870514afe967f6aa635609f99
I20260812 06:13:06.860908 3327 ts_tablet_manager.cc:1939] T 2726d65870514afe967f6aa635609f99 P f6d0a4ff01944df9bc8ca8a10ee38b40: Deleting consensus metadata
I20260812 06:13:06.861369 2379 catalog_manager.cc:4841] TS f6d0a4ff01944df9bc8ca8a10ee38b40 (127.0.176.193:35309): tablet 2726d65870514afe967f6aa635609f99 (table test-table [id=df92f3866d61425da48988872b83ef66]) successfully deleted
I20260812 06:13:06.862597 3331 ts_tablet_manager.cc:1918] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:06.862764 3331 log.cc:1196] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/2726d65870514afe967f6aa635609f99
I20260812 06:13:06.863088 3331 ts_tablet_manager.cc:1939] T 2726d65870514afe967f6aa635609f99 P 9879cda1e93048079830f378368e7279: Deleting consensus metadata
I20260812 06:13:06.863262 3329 tablet_replica.cc:330] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77: stopping tablet replica
I20260812 06:13:06.863461 3329 raft_consensus.cc:2229] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:06.863869 2379 catalog_manager.cc:4841] TS 9879cda1e93048079830f378368e7279 (127.0.176.194:36877): tablet 2726d65870514afe967f6aa635609f99 (table test-table [id=df92f3866d61425da48988872b83ef66]) successfully deleted
I20260812 06:13:06.864038 3329 raft_consensus.cc:2258] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:06.864454 3329 ts_tablet_manager.cc:1905] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:06.864789 3209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.854085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59872 (local address 127.0.176.193:35309)
0812 06:13:06.854136 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.854138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.854291 (+ 153us) server_negotiation.cc:407] Connection header received
0812 06:13:06.854362 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.854363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.854374 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.854421 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:06.854996 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.855576 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.856583 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.856835 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.856876 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.860968 (+ 4092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:06.860981 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:06.860982 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:06.860991 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:06.863197 (+ 2206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:06.863680 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:06.863684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:06.863684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:06.863748 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:06.863999 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:06.864000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:06.864000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:06.864192 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:06.864327 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.864574 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.864667 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 06:13:06.865478 2739 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59872
I20260812 06:13:06.867622 3329 ts_tablet_manager.cc:1918] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:06.867787 3329 log.cc:1196] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/2726d65870514afe967f6aa635609f99
I20260812 06:13:06.868184 3329 ts_tablet_manager.cc:1939] T 2726d65870514afe967f6aa635609f99 P 2c97e8e23dac4345b2e405e64e30ea77: Deleting consensus metadata
I20260812 06:13:06.868607 2383 catalog_manager.cc:4841] TS 2c97e8e23dac4345b2e405e64e30ea77 (127.0.176.195:38443): tablet 2726d65870514afe967f6aa635609f99 (table test-table [id=df92f3866d61425da48988872b83ef66]) successfully deleted
I20260812 06:13:06.874759 3276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:06.866664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34130 (local address 127.0.176.254:38001)
0812 06:13:06.866730 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:06.866732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:06.867611 (+ 879us) server_negotiation.cc:407] Connection header received
0812 06:13:06.867729 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:06.867730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:06.867746 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:06.867779 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:06.868609 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.869309 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.870092 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:06.870312 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:06.870412 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:06.872025 (+ 1613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:06.872027 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:06.872028 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:06.872037 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:06.873536 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:06.873905 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:06.873906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:06.873907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:06.873969 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:06.874179 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:06.874180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:06.874180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:06.874302 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:06.874413 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:06.874541 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 06:13:06.874636 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260812 06:13:06.875001 2405 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34130
I20260812 06:13:06.875756 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 2538
I20260812 06:13:06.937593 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 2760
I20260812 06:13:06.958097 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 2968
I20260812 06:13:06.982986 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 2356
2026-08-12T06:13:06Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3154 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:13:07 dist-test-slave-gw5c krb5kdc[3339](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:13:07 dist-test-slave-gw5c krb5kdc[3339](info): set up 2 sockets
Aug 12 06:13:07 dist-test-slave-gw5c krb5kdc[3339](info): commencing operation
krb5kdc: starting...
W20260812 06:13:08.293970 707 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:08 dist-test-slave-gw5c krb5kdc[3339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:13:08.426493 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:39395
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:36121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:39395
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:08.511623 3362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:08.511861 3362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:08.511885 3362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:08.513070 3362 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:08.513124 3362 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:13:08.513137 3362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:08.513150 3362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:08.513163 3362 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:08.513176 3362 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:08.514778 3362 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:36121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:39395
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:39395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:08.515051 3362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:08.515316 3362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:08.520411 3371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:08.520404 3375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:08.520406 3372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:08.520800 3362 server_base.cc:1034] running on GCE node
I20260812 06:13:08.521092 3362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:08.521417 3362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:08.523208 3362 hybrid_clock.cc:648] HybridClock initialized: now 1786515188523175 us; error 29 us; skew 500 ppm
Aug 12 06:13:08 dist-test-slave-gw5c krb5kdc[3339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515188, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:08.526700 3362 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:13:08.527197 3362 webserver.cc:460] Webserver started at http://127.0.176.254:45135/ using document root <none> and password file <none>
I20260812 06:13:08.527498 3362 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:08.527570 3362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:08.527738 3362 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:08.528858 3362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "05bf4673441b4342ac3bac1109292d14"
format_stamp: "Formatted at 2026-08-12 06:13:08 on dist-test-slave-gw5c"
server_key: "4969975703dfb79348db2d9ef0f5bfcc"
server_key_iv: "948e3fb12cfc75592096c45d894fdff9"
server_key_version: "encryptionkey@0"
I20260812 06:13:08.529340 3362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "05bf4673441b4342ac3bac1109292d14"
format_stamp: "Formatted at 2026-08-12 06:13:08 on dist-test-slave-gw5c"
server_key: "4969975703dfb79348db2d9ef0f5bfcc"
server_key_iv: "948e3fb12cfc75592096c45d894fdff9"
server_key_version: "encryptionkey@0"
I20260812 06:13:08.530810 3362 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:08.531832 3385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:08.532017 3362 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:13:08.532122 3362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "05bf4673441b4342ac3bac1109292d14"
format_stamp: "Formatted at 2026-08-12 06:13:08 on dist-test-slave-gw5c"
server_key: "4969975703dfb79348db2d9ef0f5bfcc"
server_key_iv: "948e3fb12cfc75592096c45d894fdff9"
server_key_version: "encryptionkey@0"
I20260812 06:13:08.532213 3362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:08.560986 3362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:08.564241 3362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:08.564476 3362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:08.569727 3362 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:39395
I20260812 06:13:08.569842 3475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:39395 every 8 connection(s)
I20260812 06:13:08.570199 3362 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:08.571165 3476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:08.573379 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 3362
I20260812 06:13:08.573495 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:08.573657 707 external_mini_cluster.cc:1428] Setting key 6343bd7d29f59db962f107b4dadf95e6
I20260812 06:13:08.573932 3476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14: Bootstrap starting.
I20260812 06:13:08.574782 3476 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:08.575132 3476 log.cc:824] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:08.575953 3476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14: No bootstrap required, opened a new log
I20260812 06:13:08.577826 3476 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05bf4673441b4342ac3bac1109292d14" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39395 } }
I20260812 06:13:08.578011 3476 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:08.578080 3476 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05bf4673441b4342ac3bac1109292d14, State: Initialized, Role: FOLLOWER
I20260812 06:13:08.578233 3476 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05bf4673441b4342ac3bac1109292d14" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39395 } }
I20260812 06:13:08.578315 3476 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:08.578359 3476 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:08.578408 3476 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:08.579068 3476 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05bf4673441b4342ac3bac1109292d14" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39395 } }
I20260812 06:13:08.579190 3476 leader_election.cc:302] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05bf4673441b4342ac3bac1109292d14; no voters:
I20260812 06:13:08.579442 3476 leader_election.cc:288] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:08.579468 3484 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:08.579598 3484 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [term 1 LEADER]: Becoming Leader. State: Replica: 05bf4673441b4342ac3bac1109292d14, State: Running, Role: LEADER
I20260812 06:13:08.579684 3484 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05bf4673441b4342ac3bac1109292d14" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39395 } }
I20260812 06:13:08.579751 3476 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:08.580030 3488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05bf4673441b4342ac3bac1109292d14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05bf4673441b4342ac3bac1109292d14" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39395 } } }
I20260812 06:13:08.580129 3488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:08.580289 3485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05bf4673441b4342ac3bac1109292d14. Latest consensus state: current_term: 1 leader_uuid: "05bf4673441b4342ac3bac1109292d14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05bf4673441b4342ac3bac1109292d14" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39395 } } }
I20260812 06:13:08.580363 3485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:08.580502 3492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:08.581061 3492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 06:13:08 dist-test-slave-gw5c krb5kdc[3339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:08.582813 3492 catalog_manager.cc:1347] Generated new cluster ID: 7b206618fba747ca99fe5951bac14749
I20260812 06:13:08.582877 3492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:08.586148 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:08.574271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60944 (local address 127.0.176.254:39395)
0812 06:13:08.574521 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:08.574530 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:08.574567 (+ 37us) server_negotiation.cc:407] Connection header received
0812 06:13:08.575253 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:08.575263 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:08.575333 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:08.575521 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:08.576245 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.577137 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.577908 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.578515 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.578642 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:08.581795 (+ 3153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:08.581798 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:08.581798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:08.581810 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:08.583853 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:08.584298 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:08.584301 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:08.584301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:08.584514 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:08.584971 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:08.584971 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:08.584972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:08.585290 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:08.585454 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:08.585694 (+ 240us) server_negotiation.cc:299] Negotiation successful
0812 06:13:08.585834 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":127,"threads_started":1}
I20260812 06:13:08.595274 3492 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:08.595876 3492 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:08.602912 3492 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14: Generated new TSK 0
I20260812 06:13:08.603122 3492 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:13:08.634896 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:39395
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:36121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:08.723589 3526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:08.723827 3526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:08.723858 3526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:08.725129 3526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:08.725179 3526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:08.725203 3526 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:13:08.725247 3526 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:13:08.725286 3526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:08.726912 3526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:36121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.176.254:39395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:08.727193 3526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:08.727546 3526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:08.733112 3536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:08.733129 3538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:08.733152 3526 server_base.cc:1034] running on GCE node
W20260812 06:13:08.733117 3535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:08.733647 3526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:08.733875 3526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:08.735035 3526 hybrid_clock.cc:648] HybridClock initialized: now 1786515188735019 us; error 32 us; skew 500 ppm
Aug 12 06:13:08 dist-test-slave-gw5c krb5kdc[3339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515188, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:08.737893 3526 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:13:08.738400 3526 webserver.cc:460] Webserver started at http://127.0.176.193:40493/ using document root <none> and password file <none>
I20260812 06:13:08.738672 3526 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:08.738750 3526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:08.738909 3526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:08.740160 3526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "a4866e3fa21044759473a1f28f1fa4c3"
format_stamp: "Formatted at 2026-08-12 06:13:08 on dist-test-slave-gw5c"
server_key: "b8b5b2ac53081f42ed0dc5c08d190108"
server_key_iv: "2e6ca5520360909351d9cf0fc946a4c4"
server_key_version: "encryptionkey@0"
I20260812 06:13:08.740584 3526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "a4866e3fa21044759473a1f28f1fa4c3"
format_stamp: "Formatted at 2026-08-12 06:13:08 on dist-test-slave-gw5c"
server_key: "b8b5b2ac53081f42ed0dc5c08d190108"
server_key_iv: "2e6ca5520360909351d9cf0fc946a4c4"
server_key_version: "encryptionkey@0"
I20260812 06:13:08.742079 3526 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:08.742915 3548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:08.743129 3526 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:08.743252 3526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "a4866e3fa21044759473a1f28f1fa4c3"
format_stamp: "Formatted at 2026-08-12 06:13:08 on dist-test-slave-gw5c"
server_key: "b8b5b2ac53081f42ed0dc5c08d190108"
server_key_iv: "2e6ca5520360909351d9cf0fc946a4c4"
server_key_version: "encryptionkey@0"
I20260812 06:13:08.743335 3526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:08.752482 3526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:08.754575 3526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:08.754699 3526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:08.755213 3526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:08.755255 3526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:08.755277 3526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:08.755295 3526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:08.762604 3526 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:46759
I20260812 06:13:08.762660 3741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:46759 every 8 connection(s)
Aug 12 06:13:08 dist-test-slave-gw5c krb5kdc[3339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515188, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:08.763017 3526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:08.766287 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:08.755920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:47571 (local address 127.0.176.254:39395)
0812 06:13:08.755983 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:08.755986 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:08.756227 (+ 241us) server_negotiation.cc:407] Connection header received
0812 06:13:08.756819 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:08.756821 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:08.756836 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:08.756918 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:08.757806 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.758666 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.760353 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.760721 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.760815 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:08.763612 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:08.763613 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:08.763614 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:08.763622 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:08.764868 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:08.765286 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:08.765288 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:08.765288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:08.765351 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:08.765613 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:08.765614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:08.765614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:08.765737 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:08.765814 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:08.766100 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 06:13:08.766195 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:13:08.766470 3562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:08.755896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:39395 (local address 127.0.176.193:47571)
0812 06:13:08.756105 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:08.756142 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:08.756666 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:08.757006 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:08.757011 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:08.757396 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:08.757698 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:08.757706 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.758778 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.758779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:08.760241 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:08.760245 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.760834 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.760835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:08.760978 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:08.761667 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:08.761679 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:08.763514 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:08.764956 (+ 1442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:08.764964 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:08.764967 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:08.765196 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:08.765418 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:08.765419 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:08.765420 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:08.765537 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:08.765810 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:08.765818 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:08.765961 (+ 143us) client_negotiation.cc:769] Sending connection context
0812 06:13:08.766063 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 06:13:08.766227 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":114,"threads_started":1}
I20260812 06:13:08.767024 3742 heartbeater.cc:347] Connected to a master server at 127.0.176.254:39395
I20260812 06:13:08.767117 3742 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:08.767319 3742 heartbeater.cc:511] Master 127.0.176.254:39395 requested a full tablet report, sending...
I20260812 06:13:08.767894 3405 ts_manager.cc:194] Registered new tserver with Master: a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193:46759)
I20260812 06:13:08.768615 3405 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:47571
I20260812 06:13:08.771605 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 3526
I20260812 06:13:08.771713 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:08.771906 707 external_mini_cluster.cc:1428] Setting key 929f988679223568c727efeaa7332b22
I20260812 06:13:08.773963 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:08.768120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:58387 (local address 127.0.176.254:39395)
0812 06:13:08.768155 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:08.768157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:08.768314 (+ 157us) server_negotiation.cc:407] Connection header received
0812 06:13:08.768380 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:08.768381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:08.768391 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:08.768444 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:08.768779 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.769283 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.769997 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.770193 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.770269 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:08.771144 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:08.771146 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:08.771146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:08.771154 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:08.772879 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:08.773260 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:08.773261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:08.773261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:08.773312 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:08.773509 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:08.773509 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:08.773510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:08.773605 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:08.773654 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:08.773824 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 06:13:08.773898 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:13:08.774078 3752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:08.768080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:39395 (local address 127.0.176.193:58387)
0812 06:13:08.768237 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:08.768247 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:08.768322 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:08.768453 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:08.768454 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:08.768632 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:08.768707 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:08.768709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.769384 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.769385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:08.769898 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:08.769899 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.770266 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.770267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:08.770348 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:08.770766 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:08.770770 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:08.771054 (+ 284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:08.772957 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:08.772958 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:08.772959 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:08.773185 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:08.773376 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:08.773377 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:08.773377 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:08.773448 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:08.773673 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:08.773674 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:08.773727 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 06:13:08.773807 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 06:13:08.773928 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:13:08.800012 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:39395
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:36121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:08.886891 3756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:08.887113 3756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:08.887142 3756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:08.888383 3756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:08.888432 3756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:08.888453 3756 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:13:08.888465 3756 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:13:08.888482 3756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:08.889992 3756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:36121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.176.254:39395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:08.890251 3756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:08.890511 3756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:08.895771 3767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:08.895985 3756 server_base.cc:1034] running on GCE node
W20260812 06:13:08.895776 3761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:08.895771 3762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:08.896275 3756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:08.896580 3756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:08.897758 3756 hybrid_clock.cc:648] HybridClock initialized: now 1786515188897742 us; error 30 us; skew 500 ppm
Aug 12 06:13:08 dist-test-slave-gw5c krb5kdc[3339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515188, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:08.900455 3756 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:13:08.901026 3756 webserver.cc:460] Webserver started at http://127.0.176.194:33291/ using document root <none> and password file <none>
I20260812 06:13:08.901268 3756 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:08.901314 3756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:08.901410 3756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:08.902455 3756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "b013ba80ae67498e93fd609741af40b1"
format_stamp: "Formatted at 2026-08-12 06:13:08 on dist-test-slave-gw5c"
server_key: "7a8342156710d2b8a91932dd816cd08f"
server_key_iv: "59ce46713cfb763a5c96ba6cbaf3b52e"
server_key_version: "encryptionkey@0"
I20260812 06:13:08.902777 3756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "b013ba80ae67498e93fd609741af40b1"
format_stamp: "Formatted at 2026-08-12 06:13:08 on dist-test-slave-gw5c"
server_key: "7a8342156710d2b8a91932dd816cd08f"
server_key_iv: "59ce46713cfb763a5c96ba6cbaf3b52e"
server_key_version: "encryptionkey@0"
I20260812 06:13:08.904246 3756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:08.905000 3778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:08.905189 3756 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:08.905258 3756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "b013ba80ae67498e93fd609741af40b1"
format_stamp: "Formatted at 2026-08-12 06:13:08 on dist-test-slave-gw5c"
server_key: "7a8342156710d2b8a91932dd816cd08f"
server_key_iv: "59ce46713cfb763a5c96ba6cbaf3b52e"
server_key_version: "encryptionkey@0"
I20260812 06:13:08.905362 3756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:08.913069 3756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:08.915268 3756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:08.915496 3756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:08.916061 3756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:08.916101 3756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:08.916124 3756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:08.916182 3756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:08.923151 3756 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:42363
I20260812 06:13:08.923239 3964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:42363 every 8 connection(s)
I20260812 06:13:08.923790 3756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:13:08 dist-test-slave-gw5c krb5kdc[3339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515188, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:08.925838 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 3756
I20260812 06:13:08.925993 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:13:08.926184 707 external_mini_cluster.cc:1428] Setting key 50a9683f4d3af892833318f7ab46faa5
I20260812 06:13:08.927718 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:08.916702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:40781 (local address 127.0.176.254:39395)
0812 06:13:08.916763 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:08.916765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:08.917055 (+ 290us) server_negotiation.cc:407] Connection header received
0812 06:13:08.917700 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:08.917702 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:08.917715 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:08.917789 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:08.918677 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.919597 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.921285 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.921492 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.921588 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:08.924634 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:08.924636 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:08.924637 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:08.924645 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:08.925921 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:08.926483 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:08.926484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:08.926485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:08.926564 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:08.926884 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:08.926885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:08.926886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:08.927047 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:08.927128 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:08.927446 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 06:13:08.927550 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 06:13:08.927843 3795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:08.916683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:39395 (local address 127.0.176.194:40781)
0812 06:13:08.916902 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:08.916951 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:08.917542 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:08.917875 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:08.917879 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:08.918252 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:08.918560 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:08.918566 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.919704 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.919705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:08.921130 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:08.921133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.921600 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.921601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:08.921778 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:08.922493 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:08.922505 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:08.924517 (+ 2012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:08.926024 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:08.926033 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:08.926035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:08.926365 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:08.926647 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:08.926647 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:08.926648 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:08.926800 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:08.927127 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:08.927132 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:08.927275 (+ 143us) client_negotiation.cc:769] Sending connection context
0812 06:13:08.927370 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 06:13:08.927594 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":108,"threads_started":1}
I20260812 06:13:08.928452 3965 heartbeater.cc:347] Connected to a master server at 127.0.176.254:39395
I20260812 06:13:08.928547 3965 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:08.928756 3965 heartbeater.cc:511] Master 127.0.176.254:39395 requested a full tablet report, sending...
I20260812 06:13:08.929435 3404 ts_manager.cc:194] Registered new tserver with Master: b013ba80ae67498e93fd609741af40b1 (127.0.176.194:42363)
I20260812 06:13:08.929989 3404 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:40781
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
I20260812 06:13:08.938620 3976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:08.930379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:39395 (local address 127.0.176.194:56963)
0812 06:13:08.930606 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:08.930619 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:08.930689 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:08.930837 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:08.930837 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:08.931091 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:08.931166 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:08.931169 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.931931 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.931932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:08.932815 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:08.932820 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.933233 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.933234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:08.933336 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:08.933884 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:08.933891 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:08.934426 (+ 535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:08.937264 (+ 2838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:08.937265 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:08.937266 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:08.937480 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:08.937905 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:08.937906 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:08.937907 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:08.937987 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:08.938304 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:08.938304 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:08.938366 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 06:13:08.938429 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 06:13:08.938536 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":101,"threads_started":1}
I20260812 06:13:08.938886 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:08.930414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:56963 (local address 127.0.176.254:39395)
0812 06:13:08.930489 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:08.930492 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:08.930697 (+ 205us) server_negotiation.cc:407] Connection header received
0812 06:13:08.930756 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:08.930757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:08.930769 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:08.930822 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:08.931261 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.931808 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.932928 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:08.933138 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:08.933209 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:08.934732 (+ 1523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:08.934735 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:08.934736 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:08.934749 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:08.937156 (+ 2407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:08.937557 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:08.937558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:08.937559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:08.937740 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:08.938062 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:08.938063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:08.938063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:08.938239 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:08.938304 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:08.938551 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 06:13:08.938697 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:13:08.957093 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:39395
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:36121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:09.045981 3978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:09.046295 3978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:09.046345 3978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:09.047786 3978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:09.047837 3978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:09.047861 3978 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:13:09.047873 3978 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:13:09.047891 3978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:09.049427 3978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:36121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.176.254:39395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:09.049640 3978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:09.049841 3978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:09.055145 3985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:09.055151 3986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:09.055171 3978 server_base.cc:1034] running on GCE node
W20260812 06:13:09.055166 3988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:09.055598 3978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:09.055933 3978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:09.057124 3978 hybrid_clock.cc:648] HybridClock initialized: now 1786515189057112 us; error 33 us; skew 500 ppm
Aug 12 06:13:09 dist-test-slave-gw5c krb5kdc[3339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515189, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:09.059902 3978 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:13:09.060384 3978 webserver.cc:460] Webserver started at http://127.0.176.195:42629/ using document root <none> and password file <none>
I20260812 06:13:09.060626 3978 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:09.060695 3978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:09.060848 3978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:09.061926 3978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "bd715a4306ea42ceaffa57cbd9f2c63f"
format_stamp: "Formatted at 2026-08-12 06:13:09 on dist-test-slave-gw5c"
server_key: "4b1fd77db630ff41d1267d6a531bd29b"
server_key_iv: "b153a66984513fb3f7e3b9db233a672f"
server_key_version: "encryptionkey@0"
I20260812 06:13:09.062305 3978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "bd715a4306ea42ceaffa57cbd9f2c63f"
format_stamp: "Formatted at 2026-08-12 06:13:09 on dist-test-slave-gw5c"
server_key: "4b1fd77db630ff41d1267d6a531bd29b"
server_key_iv: "b153a66984513fb3f7e3b9db233a672f"
server_key_version: "encryptionkey@0"
I20260812 06:13:09.063782 3978 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:13:09.064958 4001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:09.065171 3978 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:09.065299 3978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "bd715a4306ea42ceaffa57cbd9f2c63f"
format_stamp: "Formatted at 2026-08-12 06:13:09 on dist-test-slave-gw5c"
server_key: "4b1fd77db630ff41d1267d6a531bd29b"
server_key_iv: "b153a66984513fb3f7e3b9db233a672f"
server_key_version: "encryptionkey@0"
I20260812 06:13:09.065379 3978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:09.092247 3978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:09.094512 3978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:09.094698 3978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:09.095270 3978 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:09.095341 3978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:09.095440 3978 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:09.095471 3978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:13:09 dist-test-slave-gw5c krb5kdc[3339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515189, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:09.103085 3978 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:36607
I20260812 06:13:09.103178 4188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:36607 every 8 connection(s)
I20260812 06:13:09.103555 3978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:13:09.103986 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 3978
I20260812 06:13:09.104079 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:13:09.104265 707 external_mini_cluster.cc:1428] Setting key 6135fd579c1ad56bfb0c57407931f8b1
I20260812 06:13:09.106508 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.095927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:52535 (local address 127.0.176.254:39395)
0812 06:13:09.095977 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.095979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.096223 (+ 244us) server_negotiation.cc:407] Connection header received
0812 06:13:09.096770 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.096772 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.096784 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.096858 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:09.097756 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.098605 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.100391 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.100628 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.100717 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.103255 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:09.103256 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:09.103257 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:09.103265 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:09.105096 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:09.105556 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:09.105557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:09.105558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:09.105610 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:09.105795 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:09.105796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:09.105796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:09.105911 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:09.105961 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.106178 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.106255 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:13:09.106731 4017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.095899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:39395 (local address 127.0.176.195:52535)
0812 06:13:09.096095 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.096131 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.096660 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.096937 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.096940 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.097352 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:09.097671 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.097678 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.098730 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.098732 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.100287 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.100291 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.100729 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.100730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.100864 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.101528 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:09.101537 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:09.103164 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:09.105236 (+ 2072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:09.105243 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:09.105244 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:09.105489 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:09.105655 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:09.105655 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:09.105656 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:09.105743 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:09.105951 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:09.105954 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:09.106069 (+ 115us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.106147 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.106281 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":108,"threads_started":1}
I20260812 06:13:09.107250 4191 heartbeater.cc:347] Connected to a master server at 127.0.176.254:39395
I20260812 06:13:09.107342 4191 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:09.107568 4191 heartbeater.cc:511] Master 127.0.176.254:39395 requested a full tablet report, sending...
I20260812 06:13:09.108140 3404 ts_manager.cc:194] Registered new tserver with Master: bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195:36607)
I20260812 06:13:09.108672 3404 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:52535
I20260812 06:13:09.114068 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.108444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:36875 (local address 127.0.176.254:39395)
0812 06:13:09.108492 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.108494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.108658 (+ 164us) server_negotiation.cc:407] Connection header received
0812 06:13:09.108681 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.108682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.108692 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.108801 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:09.109285 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.109782 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.110477 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.110658 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.110709 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.111708 (+ 999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:09.111710 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:09.111710 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:09.111716 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:09.113194 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:09.113504 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:09.113505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:09.113505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:09.113550 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:09.113698 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:09.113698 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:09.113698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:09.113786 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:09.113833 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.113945 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.114002 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:13:09.114089 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.108386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:39395 (local address 127.0.176.195:36875)
0812 06:13:09.108537 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.108549 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.108613 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.108834 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.108835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.109106 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:09.109172 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.109175 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.109900 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.109901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.110403 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.110404 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.110729 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.110730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.110790 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.111222 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:09.111226 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:09.111628 (+ 402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:09.113275 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:09.113276 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:09.113276 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:09.113444 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:09.113606 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:09.113607 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:09.113607 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:09.113659 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:09.113834 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:09.113834 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:09.113872 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.113932 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.114013 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260812 06:13:09.116093 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:13:09 dist-test-slave-gw5c krb5kdc[3339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:13:09 dist-test-slave-gw5c krb5kdc[3339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:09.141806 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.134118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60950 (local address 127.0.176.254:39395)
0812 06:13:09.134288 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.134290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.134299 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:09.134326 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.134326 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.134335 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.134390 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:09.134948 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.135609 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.136666 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.136995 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.137080 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.139372 (+ 2292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:09.139374 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:09.139374 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:09.139383 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:09.140615 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:09.140971 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:09.140972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:09.140973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:09.141032 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:09.141247 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:09.141248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:09.141249 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:09.141374 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:09.141491 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.141605 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.141693 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260812 06:13:09.143846 3404 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60950:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:13:09.145545 3404 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:09.153017 4217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.148507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:36607 (local address 127.0.0.1:58598)
0812 06:13:09.148640 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.148681 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.148755 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.149345 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.149348 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.149350 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:09.149430 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.149432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.150369 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.150370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.151656 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.151659 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.152672 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.152673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.152763 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.152778 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.152857 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.152911 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":83,"threads_started":1}
I20260812 06:13:09.153057 4221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.148704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58598 (local address 127.0.176.195:36607)
0812 06:13:09.149153 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.149157 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.149168 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:09.149212 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.149214 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.149231 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.149517 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:09.149579 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.150271 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.151749 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.152537 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.152650 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.152722 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.152895 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.152948 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":102,"threads_started":1}
I20260812 06:13:09.153182 4222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.148858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60278 (local address 127.0.176.194:42363)
0812 06:13:09.149036 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.149042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.149122 (+ 80us) server_negotiation.cc:407] Connection header received
0812 06:13:09.149208 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.149211 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.149229 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.149309 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:09.149529 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.150688 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.151961 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.152676 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.152739 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.152783 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.153020 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.153072 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":108,"threads_started":1}
I20260812 06:13:09.153491 4219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.148560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:46759 (local address 127.0.0.1:48834)
0812 06:13:09.149218 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.149228 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.149273 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.149555 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.149556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.149557 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:09.149595 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.149597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.150818 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.150819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.151790 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.151793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.153261 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.153262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.153326 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.153331 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.153383 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.153425 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"mutex_wait_us":2,"thread_start_us":129,"threads_started":1}
I20260812 06:13:09.153748 4224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.148930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48834 (local address 127.0.176.193:46759)
0812 06:13:09.149106 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.149111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.149334 (+ 223us) server_negotiation.cc:407] Connection header received
0812 06:13:09.149392 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.149394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.149409 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.149482 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:09.149670 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.150753 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.151881 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.152506 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.152652 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.152722 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.153604 (+ 882us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.153653 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":101,"threads_started":1}
I20260812 06:13:09.153949 4220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.148560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:42363 (local address 127.0.0.1:60278)
0812 06:13:09.149064 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.149074 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.149137 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.149381 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.149382 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.149384 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:09.149449 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.149451 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.150786 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.150787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.151889 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.151891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.152826 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.152827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.152919 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.152923 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.152989 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.153037 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":128,"threads_started":1}
I20260812 06:13:09.153883 4080 tablet_service.cc:1467] Processing CreateTablet for tablet 0a4dcc0c3ded47bd8e3d6fac41f36a66 (DEFAULT_TABLE table=test-table [id=22647b7eb7e84a5d81dce1ca3d7122fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:09.154306 4080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a4dcc0c3ded47bd8e3d6fac41f36a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:09.154345 3625 tablet_service.cc:1467] Processing CreateTablet for tablet 0a4dcc0c3ded47bd8e3d6fac41f36a66 (DEFAULT_TABLE table=test-table [id=22647b7eb7e84a5d81dce1ca3d7122fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:09.154619 3864 tablet_service.cc:1467] Processing CreateTablet for tablet 0a4dcc0c3ded47bd8e3d6fac41f36a66 (DEFAULT_TABLE table=test-table [id=22647b7eb7e84a5d81dce1ca3d7122fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:09.154781 3625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a4dcc0c3ded47bd8e3d6fac41f36a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:09.154877 3864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a4dcc0c3ded47bd8e3d6fac41f36a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:09.158226 4225 tablet_bootstrap.cc:492] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1: Bootstrap starting.
I20260812 06:13:09.158494 4226 tablet_bootstrap.cc:492] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f: Bootstrap starting.
I20260812 06:13:09.158586 4227 tablet_bootstrap.cc:492] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3: Bootstrap starting.
I20260812 06:13:09.159137 4225 tablet_bootstrap.cc:654] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:09.159344 4227 tablet_bootstrap.cc:654] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:09.159475 4226 tablet_bootstrap.cc:654] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:09.159538 4225 log.cc:824] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:09.159729 4227 log.cc:824] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:09.159834 4226 log.cc:824] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:09.160487 4225 tablet_bootstrap.cc:492] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1: No bootstrap required, opened a new log
I20260812 06:13:09.160542 4227 tablet_bootstrap.cc:492] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3: No bootstrap required, opened a new log
I20260812 06:13:09.160595 4227 ts_tablet_manager.cc:1397] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:13:09.160593 4225 ts_tablet_manager.cc:1397] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:13:09.160663 4226 tablet_bootstrap.cc:492] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f: No bootstrap required, opened a new log
I20260812 06:13:09.160735 4226 ts_tablet_manager.cc:1397] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:13:09.162354 4226 raft_consensus.cc:348] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } }
I20260812 06:13:09.162552 4226 raft_consensus.cc:374] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:09.162617 4226 raft_consensus.cc:729] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd715a4306ea42ceaffa57cbd9f2c63f, State: Initialized, Role: FOLLOWER
I20260812 06:13:09.162774 4226 consensus_queue.cc:260] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } }
I20260812 06:13:09.162701 4225 raft_consensus.cc:348] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } }
I20260812 06:13:09.162701 4227 raft_consensus.cc:348] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } }
I20260812 06:13:09.162865 4225 raft_consensus.cc:374] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:09.162865 4227 raft_consensus.cc:374] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:09.162914 4225 raft_consensus.cc:729] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b013ba80ae67498e93fd609741af40b1, State: Initialized, Role: FOLLOWER
I20260812 06:13:09.162914 4227 raft_consensus.cc:729] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4866e3fa21044759473a1f28f1fa4c3, State: Initialized, Role: FOLLOWER
I20260812 06:13:09.163034 4227 consensus_queue.cc:260] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } }
I20260812 06:13:09.163095 4226 ts_tablet_manager.cc:1428] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 06:13:09.163084 4225 consensus_queue.cc:260] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } }
I20260812 06:13:09.163240 4191 heartbeater.cc:503] Master 127.0.176.254:39395 was elected leader, sending a full tablet report...
I20260812 06:13:09.163328 4227 ts_tablet_manager.cc:1428] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:13:09.163328 4225 ts_tablet_manager.cc:1428] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:13:09.163513 3742 heartbeater.cc:503] Master 127.0.176.254:39395 was elected leader, sending a full tablet report...
I20260812 06:13:09.163560 3965 heartbeater.cc:503] Master 127.0.176.254:39395 was elected leader, sending a full tablet report...
W20260812 06:13:09.174576 3966 tablet.cc:2369] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:13:09.210543 4231 raft_consensus.cc:482] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:09.210687 4231 raft_consensus.cc:504] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } }
I20260812 06:13:09.211134 4231 leader_election.cc:288] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b013ba80ae67498e93fd609741af40b1 (127.0.176.194:42363), a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193:46759)
I20260812 06:13:09.213986 4017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.211300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:42363 (local address 127.0.176.195:42405)
0812 06:13:09.211352 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.211366 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.211436 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.211604 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.211606 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.211607 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:09.211690 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.211692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.212377 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.212378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.213134 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.213136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.213698 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.213699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.213789 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.213792 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.213863 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.213905 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:13:09.213986 4222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.211380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:42405 (local address 127.0.176.194:42363)
0812 06:13:09.211450 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.211453 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.211463 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:09.211497 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.211498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.211508 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.211568 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:09.211776 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.212285 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.213237 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.213609 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.213701 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.213712 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.213869 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.213920 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:13:09.214298 4224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.211501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:55477 (local address 127.0.176.193:46759)
0812 06:13:09.211582 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.211585 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.211801 (+ 216us) server_negotiation.cc:407] Connection header received
0812 06:13:09.211888 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.211889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.211900 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.211979 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:09.212142 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.212617 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.213526 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.213905 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.213990 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.214000 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.214189 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.214237 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 06:13:09.214334 3897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a4dcc0c3ded47bd8e3d6fac41f36a66" candidate_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b013ba80ae67498e93fd609741af40b1" is_pre_election: true
I20260812 06:13:09.214543 4238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.211307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:46759 (local address 127.0.176.195:55477)
0812 06:13:09.211630 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.211639 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.211816 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.211982 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.211983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.211984 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:09.212067 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.212069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.212705 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.212707 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.213429 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.213431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.214005 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.214007 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.214084 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.214089 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.214407 (+ 318us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.214456 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":74,"thread_start_us":125,"threads_started":1}
I20260812 06:13:09.214552 3897 raft_consensus.cc:2454] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd715a4306ea42ceaffa57cbd9f2c63f in term 0.
I20260812 06:13:09.214852 4007 leader_election.cc:302] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b013ba80ae67498e93fd609741af40b1, bd715a4306ea42ceaffa57cbd9f2c63f; no voters:
I20260812 06:13:09.214896 3656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a4dcc0c3ded47bd8e3d6fac41f36a66" candidate_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4866e3fa21044759473a1f28f1fa4c3" is_pre_election: true
I20260812 06:13:09.215040 3656 raft_consensus.cc:2454] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd715a4306ea42ceaffa57cbd9f2c63f in term 0.
I20260812 06:13:09.215042 4231 raft_consensus.cc:2781] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:09.215106 4231 raft_consensus.cc:482] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:09.215138 4231 raft_consensus.cc:3037] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:09.215932 4231 raft_consensus.cc:504] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } }
I20260812 06:13:09.216104 4231 leader_election.cc:288] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [CANDIDATE]: Term 1 election: Requested vote from peers b013ba80ae67498e93fd609741af40b1 (127.0.176.194:42363), a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193:46759)
I20260812 06:13:09.216256 3656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a4dcc0c3ded47bd8e3d6fac41f36a66" candidate_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4866e3fa21044759473a1f28f1fa4c3"
I20260812 06:13:09.216343 3897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a4dcc0c3ded47bd8e3d6fac41f36a66" candidate_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b013ba80ae67498e93fd609741af40b1"
I20260812 06:13:09.216348 3656 raft_consensus.cc:3037] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:09.216413 3897 raft_consensus.cc:3037] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:09.217306 3656 raft_consensus.cc:2454] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd715a4306ea42ceaffa57cbd9f2c63f in term 1.
I20260812 06:13:09.217306 3897 raft_consensus.cc:2454] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd715a4306ea42ceaffa57cbd9f2c63f in term 1.
I20260812 06:13:09.217496 4007 leader_election.cc:302] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b013ba80ae67498e93fd609741af40b1, bd715a4306ea42ceaffa57cbd9f2c63f; no voters:
I20260812 06:13:09.217595 4231 raft_consensus.cc:2781] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:09.217756 4231 raft_consensus.cc:686] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 LEADER]: Becoming Leader. State: Replica: bd715a4306ea42ceaffa57cbd9f2c63f, State: Running, Role: LEADER
I20260812 06:13:09.217873 4231 consensus_queue.cc:237] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } }
I20260812 06:13:09.218941 3403 catalog_manager.cc:5495] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f reported cstate change: term changed from 0 to 1, leader changed from <none> to bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195). New cstate: current_term: 1 leader_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } health_report { overall_health: UNKNOWN } } }
Aug 12 06:13:09 dist-test-slave-gw5c krb5kdc[3339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515188, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:09.255139 4248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.248252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:39395 (local address 127.0.0.1:60956)
0812 06:13:09.248457 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.248468 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.248538 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.248708 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.248709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.249039 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:09.249091 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.249093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.249769 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.249770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.250326 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.250328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.250742 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.250743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.250793 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.251458 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:09.251463 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:09.252844 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:09.254217 (+ 1373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:09.254225 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:09.254227 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:09.254426 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:09.254598 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:09.254599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:09.254599 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:09.254652 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:09.254852 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:09.254858 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:09.254898 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.254950 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.255043 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":97,"threads_started":1}
I20260812 06:13:09.255213 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.248348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60956 (local address 127.0.176.254:39395)
0812 06:13:09.248452 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.248454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.248534 (+ 80us) server_negotiation.cc:407] Connection header received
0812 06:13:09.248588 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.248588 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.248601 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.248654 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:09.249191 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.249689 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.250439 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.250636 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.250711 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.252932 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:09.252934 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:09.252934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:09.252941 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:09.254144 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:09.254491 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:09.254492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:09.254492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:09.254543 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:09.254703 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:09.254703 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:09.254703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:09.254801 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:09.254851 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.254980 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.255087 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":74}
I20260812 06:13:09.257323 3403 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:60956:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 06:13:09.257578 3403 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:09.259496 3625 tablet_service.cc:1467] Processing CreateTablet for tablet 895ba1d00ade4ea683ac3ac9fc111b44 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=578c9518d8dd4b459006337f6f2f67f9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:13:09.259496 3864 tablet_service.cc:1467] Processing CreateTablet for tablet 895ba1d00ade4ea683ac3ac9fc111b44 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=578c9518d8dd4b459006337f6f2f67f9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:13:09.259692 3625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 895ba1d00ade4ea683ac3ac9fc111b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:09.259692 3864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 895ba1d00ade4ea683ac3ac9fc111b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:09.259752 4080 tablet_service.cc:1467] Processing CreateTablet for tablet 895ba1d00ade4ea683ac3ac9fc111b44 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=578c9518d8dd4b459006337f6f2f67f9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:13:09.259949 4080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 895ba1d00ade4ea683ac3ac9fc111b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:09.261264 4226 tablet_bootstrap.cc:492] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f: Bootstrap starting.
I20260812 06:13:09.261336 4225 tablet_bootstrap.cc:492] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1: Bootstrap starting.
I20260812 06:13:09.261766 4226 tablet_bootstrap.cc:654] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:09.262090 4225 tablet_bootstrap.cc:654] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:09.262518 4227 tablet_bootstrap.cc:492] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3: Bootstrap starting.
I20260812 06:13:09.262629 4226 tablet_bootstrap.cc:492] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f: No bootstrap required, opened a new log
I20260812 06:13:09.262669 4226 ts_tablet_manager.cc:1397] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:09.262869 4226 raft_consensus.cc:348] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.262984 4226 raft_consensus.cc:374] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:09.263010 4226 raft_consensus.cc:729] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd715a4306ea42ceaffa57cbd9f2c63f, State: Initialized, Role: FOLLOWER
I20260812 06:13:09.263058 4226 consensus_queue.cc:260] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.263178 4226 ts_tablet_manager.cc:1428] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:09.263283 4227 tablet_bootstrap.cc:654] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:09.263808 4231 tablet_replica.cc:439] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } }
I20260812 06:13:09.263895 4231 tablet_replica.cc:442] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:13:09.263998 3743 tablet.cc:2369] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:13:09.264353 4225 tablet_bootstrap.cc:492] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1: No bootstrap required, opened a new log
I20260812 06:13:09.264436 4225 ts_tablet_manager.cc:1397] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 06:13:09.264617 4225 raft_consensus.cc:348] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.264690 4225 raft_consensus.cc:374] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:09.264827 4225 raft_consensus.cc:729] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b013ba80ae67498e93fd609741af40b1, State: Initialized, Role: FOLLOWER
I20260812 06:13:09.264915 4225 consensus_queue.cc:260] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.265071 4225 ts_tablet_manager.cc:1428] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 06:13:09.265157 4237 tablet_replica.cc:439] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } }
I20260812 06:13:09.265261 4237 tablet_replica.cc:442] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:09.265515 4227 tablet_bootstrap.cc:492] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3: No bootstrap required, opened a new log
I20260812 06:13:09.265592 4227 ts_tablet_manager.cc:1397] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 06:13:09.265753 4227 raft_consensus.cc:348] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.265830 4227 raft_consensus.cc:374] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:09.265861 4227 raft_consensus.cc:729] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4866e3fa21044759473a1f28f1fa4c3, State: Initialized, Role: FOLLOWER
I20260812 06:13:09.265913 4227 consensus_queue.cc:260] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.266009 4227 ts_tablet_manager.cc:1428] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:09.266088 4233 tablet_replica.cc:439] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } }
I20260812 06:13:09.266206 4233 tablet_replica.cc:442] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:13:09.354890 4194 tablet.cc:2369] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:13:09.454666 4237 raft_consensus.cc:482] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:09.454779 4237 raft_consensus.cc:504] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.455188 4237 leader_election.cc:288] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193:46759), bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195:36607)
I20260812 06:13:09.458227 4224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.455523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:54601 (local address 127.0.176.193:46759)
0812 06:13:09.455604 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.455606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.455643 (+ 37us) server_negotiation.cc:407] Connection header received
0812 06:13:09.455742 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.455743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.455754 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.455827 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:09.455973 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.456461 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.457482 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.457844 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.457937 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.457946 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.458107 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.458149 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 06:13:09.458221 4221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.455532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:56661 (local address 127.0.176.195:36607)
0812 06:13:09.455588 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.455591 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.455716 (+ 125us) server_negotiation.cc:407] Connection header received
0812 06:13:09.455811 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.455812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.455822 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.455894 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:09.456068 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.456541 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.457477 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.457847 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.457933 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.457943 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.458099 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.458140 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:13:09.458271 4257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.455424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:46759 (local address 127.0.176.194:54601)
0812 06:13:09.455579 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.455592 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.455661 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.455832 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.455833 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.455835 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:09.455904 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.455905 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.456553 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.456554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.457369 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.457371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.457937 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.457938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.458014 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.458018 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.458094 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.458138 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":3,"thread_start_us":66,"threads_started":1}
I20260812 06:13:09.458292 4255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.455424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:36607 (local address 127.0.176.194:56661)
0812 06:13:09.455612 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.455624 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.455730 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.455910 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.455911 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.455913 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:09.455993 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.455994 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.456631 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.456632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.457379 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.457381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.457942 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.457943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.458022 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.458025 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.458092 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.458134 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":24,"thread_start_us":63,"threads_started":1}
I20260812 06:13:09.458509 3656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895ba1d00ade4ea683ac3ac9fc111b44" candidate_uuid: "b013ba80ae67498e93fd609741af40b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4866e3fa21044759473a1f28f1fa4c3" is_pre_election: true
I20260812 06:13:09.458608 3656 raft_consensus.cc:2454] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b013ba80ae67498e93fd609741af40b1 in term 0.
I20260812 06:13:09.458652 4112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895ba1d00ade4ea683ac3ac9fc111b44" candidate_uuid: "b013ba80ae67498e93fd609741af40b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" is_pre_election: true
I20260812 06:13:09.458804 4112 raft_consensus.cc:2454] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b013ba80ae67498e93fd609741af40b1 in term 0.
I20260812 06:13:09.458879 3784 leader_election.cc:302] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4866e3fa21044759473a1f28f1fa4c3, b013ba80ae67498e93fd609741af40b1; no voters:
I20260812 06:13:09.459064 4237 raft_consensus.cc:2781] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:09.459117 4237 raft_consensus.cc:482] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:09.459149 4237 raft_consensus.cc:3037] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:09.459899 4237 raft_consensus.cc:504] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.460060 4237 leader_election.cc:288] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [CANDIDATE]: Term 1 election: Requested vote from peers a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193:46759), bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195:36607)
I20260812 06:13:09.460216 4112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895ba1d00ade4ea683ac3ac9fc111b44" candidate_uuid: "b013ba80ae67498e93fd609741af40b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f"
I20260812 06:13:09.460243 3656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895ba1d00ade4ea683ac3ac9fc111b44" candidate_uuid: "b013ba80ae67498e93fd609741af40b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4866e3fa21044759473a1f28f1fa4c3"
I20260812 06:13:09.460304 4112 raft_consensus.cc:3037] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:09.460325 3656 raft_consensus.cc:3037] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:09.460975 3656 raft_consensus.cc:2454] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b013ba80ae67498e93fd609741af40b1 in term 1.
I20260812 06:13:09.461030 4112 raft_consensus.cc:2454] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b013ba80ae67498e93fd609741af40b1 in term 1.
I20260812 06:13:09.461210 3784 leader_election.cc:302] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4866e3fa21044759473a1f28f1fa4c3, b013ba80ae67498e93fd609741af40b1; no voters:
I20260812 06:13:09.461335 4237 raft_consensus.cc:2781] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:09.461449 4237 raft_consensus.cc:686] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [term 1 LEADER]: Becoming Leader. State: Replica: b013ba80ae67498e93fd609741af40b1, State: Running, Role: LEADER
I20260812 06:13:09.461556 4237 consensus_queue.cc:237] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.462054 4258 tablet_replica.cc:439] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1: TxnStatusTablet state changed. Reason: New leader b013ba80ae67498e93fd609741af40b1. Latest consensus state: current_term: 1 leader_uuid: "b013ba80ae67498e93fd609741af40b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } }
I20260812 06:13:09.462148 4258 tablet_replica.cc:442] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:13:09.462430 3403 catalog_manager.cc:5495] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b013ba80ae67498e93fd609741af40b1 (127.0.176.194). New cstate: current_term: 1 leader_uuid: "b013ba80ae67498e93fd609741af40b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } health_report { overall_health: UNKNOWN } } }
I20260812 06:13:09.462760 4266 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:13:09.462869 4266 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 06:13:09.493696 4222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.490783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60286 (local address 127.0.176.194:42363)
0812 06:13:09.490852 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.490854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.490866 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:13:09.490928 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.490929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.490948 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.490998 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:09.491161 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.491687 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.492843 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.493054 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.493118 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.493362 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:09.493468 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:09.493535 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.493607 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.493631 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 06:13:09.493737 4248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.490675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:42363 (local address 127.0.0.1:60286)
0812 06:13:09.490773 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.490788 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.490851 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.491028 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.491029 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.491030 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:13:09.491088 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.491090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.491767 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.491768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.492721 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.492723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.493143 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.493145 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.493215 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.493244 (+ 29us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:13:09.493544 (+ 300us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:13:09.493553 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.493598 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.493651 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 06:13:09.495712 3656 raft_consensus.cc:1261] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Refusing update from remote peer b013ba80ae67498e93fd609741af40b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:09.495752 4112 raft_consensus.cc:1261] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Refusing update from remote peer b013ba80ae67498e93fd609741af40b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:09.496078 4258 consensus_queue.cc:1035] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:09.496258 4237 consensus_queue.cc:1035] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:09.497546 4233 tablet_replica.cc:439] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3: TxnStatusTablet state changed. Reason: New leader b013ba80ae67498e93fd609741af40b1. Latest consensus state: current_term: 1 leader_uuid: "b013ba80ae67498e93fd609741af40b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } }
I20260812 06:13:09.497551 4231 tablet_replica.cc:439] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f: TxnStatusTablet state changed. Reason: New leader b013ba80ae67498e93fd609741af40b1. Latest consensus state: current_term: 1 leader_uuid: "b013ba80ae67498e93fd609741af40b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } }
I20260812 06:13:09.497663 4231 tablet_replica.cc:442] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:09.497664 4233 tablet_replica.cc:442] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:09.498785 4258 tablet_replica.cc:439] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b013ba80ae67498e93fd609741af40b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } }
I20260812 06:13:09.498884 4258 tablet_replica.cc:442] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:13:09.498940 4258 tablet_replica.cc:439] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b013ba80ae67498e93fd609741af40b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } }
I20260812 06:13:09.499013 4258 tablet_replica.cc:442] T 895ba1d00ade4ea683ac3ac9fc111b44 P b013ba80ae67498e93fd609741af40b1: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:13:09.499083 4276 mvcc.cc:205] Tried to move back new op lower bound from 7317566216171499520 to 7317566216035328000. Current Snapshot: MvccSnapshot[applied={T|T < 7317566216171499520}]
I20260812 06:13:09.499138 4233 tablet_replica.cc:439] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b013ba80ae67498e93fd609741af40b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } }
I20260812 06:13:09.499219 4233 tablet_replica.cc:442] T 895ba1d00ade4ea683ac3ac9fc111b44 P a4866e3fa21044759473a1f28f1fa4c3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:09.499271 4277 mvcc.cc:205] Tried to move back new op lower bound from 7317566216171499520 to 7317566216035328000. Current Snapshot: MvccSnapshot[applied={T|T < 7317566216171499520}]
I20260812 06:13:09.499668 4231 tablet_replica.cc:439] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b013ba80ae67498e93fd609741af40b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } } }
I20260812 06:13:09.499758 4231 tablet_replica.cc:442] T 895ba1d00ade4ea683ac3ac9fc111b44 P bd715a4306ea42ceaffa57cbd9f2c63f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:09.500393 4278 mvcc.cc:205] Tried to move back new op lower bound from 7317566216171499520 to 7317566216035328000. Current Snapshot: MvccSnapshot[applied={T|T < 7317566216171499520}]
I20260812 06:13:09.504575 4221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.501734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58606 (local address 127.0.176.195:36607)
0812 06:13:09.501801 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.501803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.501812 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:09.501844 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.501845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.501864 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.501940 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:09.502085 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.502837 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.503712 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.504022 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.504103 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.504239 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:09.504370 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:09.504452 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.504471 (+ 19us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.504493 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 06:13:09.510001 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.507171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:42363 (local address 127.0.176.195:51789)
0812 06:13:09.507245 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.507257 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.507304 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.507594 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.507595 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.507596 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:13:09.507663 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.507664 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.508354 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.508356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.509107 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.509110 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.509520 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.509521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.509590 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.509617 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:13:09.509836 (+ 219us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:13:09.509838 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.509887 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.509932 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 06:13:09.510001 4222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.507431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:51789 (local address 127.0.176.194:42363)
0812 06:13:09.507472 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.507475 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.507483 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:13:09.507507 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.507508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.507526 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.507589 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:09.507751 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.508233 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.509232 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.509443 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.509520 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.509727 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:09.509764 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:09.509834 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.509897 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.509919 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:13:09.512728 3656 raft_consensus.cc:1261] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Refusing update from remote peer bd715a4306ea42ceaffa57cbd9f2c63f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:09.512753 3897 raft_consensus.cc:1261] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Refusing update from remote peer bd715a4306ea42ceaffa57cbd9f2c63f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:09.513032 4239 consensus_queue.cc:1035] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:09.513183 4231 consensus_queue.cc:1035] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:09.522984 4221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.519805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:41493 (local address 127.0.176.195:36607)
0812 06:13:09.519845 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.519847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.519856 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:09.519909 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.519909 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.519921 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.519977 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:09.520130 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.520771 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.522132 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.522441 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.522481 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.522715 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:09.522755 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:09.522816 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.522904 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.522924 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:13:09.523032 4300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.519568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:36607 (local address 127.0.176.194:41493)
0812 06:13:09.519787 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.519800 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.519853 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.519978 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.519978 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.519980 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:13:09.520058 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.520060 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.520855 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.520856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.522036 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.522039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.522537 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.522538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.522606 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.522625 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:13:09.522832 (+ 207us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:13:09.522834 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.522887 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.522935 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":101,"threads_started":1}
I20260812 06:13:09.532969 3402 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:09.533109 3402 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:09.534000 3402 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14: Sending DeleteTablet for 3 replicas of tablet 0a4dcc0c3ded47bd8e3d6fac41f36a66
I20260812 06:13:09.534356 3864 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a4dcc0c3ded47bd8e3d6fac41f36a66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:09 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:60278
I20260812 06:13:09.534480 3625 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a4dcc0c3ded47bd8e3d6fac41f36a66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:09 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:48834
I20260812 06:13:09.534801 3402 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60950:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 06:13:09.534838 4080 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a4dcc0c3ded47bd8e3d6fac41f36a66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:09 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:58598
W20260812 06:13:09.534958 3402 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:09.535089 4305 tablet_replica.cc:330] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f: stopping tablet replica
I20260812 06:13:09.535714 4305 raft_consensus.cc:2229] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:13:09.535861 4305 raft_consensus.cc:2258] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:09.535606 4303 tablet_replica.cc:330] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1: stopping tablet replica
I20260812 06:13:09.536064 4303 raft_consensus.cc:2229] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:09.536137 4303 raft_consensus.cc:2258] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:09.536271 4080 tablet_service.cc:1467] Processing CreateTablet for tablet 4ffa1a6622d2455eb6d2cece082280b6 (DEFAULT_TABLE table=test-table [id=f03f2b4d7dcd404ab9661a5f719efc3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:09.536307 3625 tablet_service.cc:1467] Processing CreateTablet for tablet 4ffa1a6622d2455eb6d2cece082280b6 (DEFAULT_TABLE table=test-table [id=f03f2b4d7dcd404ab9661a5f719efc3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:09.536342 3864 tablet_service.cc:1467] Processing CreateTablet for tablet 4ffa1a6622d2455eb6d2cece082280b6 (DEFAULT_TABLE table=test-table [id=f03f2b4d7dcd404ab9661a5f719efc3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:09.536437 4080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ffa1a6622d2455eb6d2cece082280b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:09.536454 3864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ffa1a6622d2455eb6d2cece082280b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:09.536455 3625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ffa1a6622d2455eb6d2cece082280b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:09.537930 4225 tablet_bootstrap.cc:492] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1: Bootstrap starting.
I20260812 06:13:09.537937 4227 tablet_bootstrap.cc:492] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3: Bootstrap starting.
I20260812 06:13:09.538399 4225 tablet_bootstrap.cc:654] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:09.538789 4227 tablet_bootstrap.cc:654] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:09.539211 4303 ts_tablet_manager.cc:1905] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:09.539492 4225 tablet_bootstrap.cc:492] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1: No bootstrap required, opened a new log
I20260812 06:13:09.539552 4225 ts_tablet_manager.cc:1397] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:13:09.539702 4226 tablet_bootstrap.cc:492] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f: Bootstrap starting.
I20260812 06:13:09.539732 4225 raft_consensus.cc:348] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.539806 4225 raft_consensus.cc:374] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:09.539821 4225 raft_consensus.cc:729] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b013ba80ae67498e93fd609741af40b1, State: Initialized, Role: FOLLOWER
I20260812 06:13:09.539878 4225 consensus_queue.cc:260] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.539973 4225 ts_tablet_manager.cc:1428] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 06:13:09.540201 4226 tablet_bootstrap.cc:654] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:09.540901 4305 ts_tablet_manager.cc:1905] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:09.541023 4226 tablet_bootstrap.cc:492] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f: No bootstrap required, opened a new log
I20260812 06:13:09.541082 4226 ts_tablet_manager.cc:1397] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:09.541286 4226 raft_consensus.cc:348] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.541385 4226 raft_consensus.cc:374] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:09.541409 4226 raft_consensus.cc:729] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd715a4306ea42ceaffa57cbd9f2c63f, State: Initialized, Role: FOLLOWER
I20260812 06:13:09.541411 4303 ts_tablet_manager.cc:1918] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:09.541491 4303 log.cc:1196] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/0a4dcc0c3ded47bd8e3d6fac41f36a66
I20260812 06:13:09.541460 4226 consensus_queue.cc:260] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.541579 4226 ts_tablet_manager.cc:1428] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 06:13:09.541939 4303 ts_tablet_manager.cc:1939] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P b013ba80ae67498e93fd609741af40b1: Deleting consensus metadata
I20260812 06:13:09.542382 4304 tablet_replica.cc:330] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3: stopping tablet replica
I20260812 06:13:09.542503 3391 catalog_manager.cc:4841] TS b013ba80ae67498e93fd609741af40b1 (127.0.176.194:42363): tablet 0a4dcc0c3ded47bd8e3d6fac41f36a66 (table test-table [id=22647b7eb7e84a5d81dce1ca3d7122fa]) successfully deleted
I20260812 06:13:09.542537 4304 raft_consensus.cc:2229] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:09.542605 4304 raft_consensus.cc:2258] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:09.542644 4305 ts_tablet_manager.cc:1918] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:09.542712 4305 log.cc:1196] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/0a4dcc0c3ded47bd8e3d6fac41f36a66
I20260812 06:13:09.543010 4305 ts_tablet_manager.cc:1939] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P bd715a4306ea42ceaffa57cbd9f2c63f: Deleting consensus metadata
I20260812 06:13:09.543151 4304 ts_tablet_manager.cc:1905] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:09.543498 3390 catalog_manager.cc:4841] TS bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195:36607): tablet 0a4dcc0c3ded47bd8e3d6fac41f36a66 (table test-table [id=22647b7eb7e84a5d81dce1ca3d7122fa]) successfully deleted
I20260812 06:13:09.544939 4304 ts_tablet_manager.cc:1918] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:09.545028 4304 log.cc:1196] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/wal/wals/0a4dcc0c3ded47bd8e3d6fac41f36a66
I20260812 06:13:09.545297 4304 ts_tablet_manager.cc:1939] T 0a4dcc0c3ded47bd8e3d6fac41f36a66 P a4866e3fa21044759473a1f28f1fa4c3: Deleting consensus metadata
I20260812 06:13:09.545765 3387 catalog_manager.cc:4841] TS a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193:46759): tablet 0a4dcc0c3ded47bd8e3d6fac41f36a66 (table test-table [id=22647b7eb7e84a5d81dce1ca3d7122fa]) successfully deleted
I20260812 06:13:09.546186 4227 tablet_bootstrap.cc:492] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3: No bootstrap required, opened a new log
I20260812 06:13:09.546262 4227 ts_tablet_manager.cc:1397] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260812 06:13:09.546433 4227 raft_consensus.cc:348] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.546517 4227 raft_consensus.cc:374] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:09.546540 4227 raft_consensus.cc:729] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4866e3fa21044759473a1f28f1fa4c3, State: Initialized, Role: FOLLOWER
I20260812 06:13:09.546586 4227 consensus_queue.cc:260] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.546701 4227 ts_tablet_manager.cc:1428] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 06:13:09.679986 4237 raft_consensus.cc:482] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:09.680146 4237 raft_consensus.cc:504] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.680358 4237 leader_election.cc:288] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193:46759), bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195:36607)
I20260812 06:13:09.680649 3656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ffa1a6622d2455eb6d2cece082280b6" candidate_uuid: "b013ba80ae67498e93fd609741af40b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4866e3fa21044759473a1f28f1fa4c3" is_pre_election: true
I20260812 06:13:09.680676 4112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ffa1a6622d2455eb6d2cece082280b6" candidate_uuid: "b013ba80ae67498e93fd609741af40b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" is_pre_election: true
I20260812 06:13:09.680783 3656 raft_consensus.cc:2454] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b013ba80ae67498e93fd609741af40b1 in term 0.
I20260812 06:13:09.680783 4112 raft_consensus.cc:2454] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b013ba80ae67498e93fd609741af40b1 in term 0.
I20260812 06:13:09.681007 3784 leader_election.cc:302] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4866e3fa21044759473a1f28f1fa4c3, b013ba80ae67498e93fd609741af40b1; no voters:
I20260812 06:13:09.681110 4237 raft_consensus.cc:2781] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:09.681159 4237 raft_consensus.cc:482] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:09.681188 4237 raft_consensus.cc:3037] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:09.682040 4237 raft_consensus.cc:504] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.682197 4237 leader_election.cc:288] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [CANDIDATE]: Term 1 election: Requested vote from peers a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193:46759), bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195:36607)
I20260812 06:13:09.682376 3656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ffa1a6622d2455eb6d2cece082280b6" candidate_uuid: "b013ba80ae67498e93fd609741af40b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4866e3fa21044759473a1f28f1fa4c3"
I20260812 06:13:09.682418 4112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ffa1a6622d2455eb6d2cece082280b6" candidate_uuid: "b013ba80ae67498e93fd609741af40b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f"
I20260812 06:13:09.682488 3656 raft_consensus.cc:3037] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:09.682499 4112 raft_consensus.cc:3037] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:09.683347 3656 raft_consensus.cc:2454] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b013ba80ae67498e93fd609741af40b1 in term 1.
I20260812 06:13:09.683522 4112 raft_consensus.cc:2454] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b013ba80ae67498e93fd609741af40b1 in term 1.
I20260812 06:13:09.683614 3784 leader_election.cc:302] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4866e3fa21044759473a1f28f1fa4c3, b013ba80ae67498e93fd609741af40b1; no voters:
I20260812 06:13:09.683708 4237 raft_consensus.cc:2781] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:09.683763 4237 raft_consensus.cc:686] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [term 1 LEADER]: Becoming Leader. State: Replica: b013ba80ae67498e93fd609741af40b1, State: Running, Role: LEADER
I20260812 06:13:09.683821 4237 consensus_queue.cc:237] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:09.684453 3402 catalog_manager.cc:5495] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b013ba80ae67498e93fd609741af40b1 (127.0.176.194). New cstate: current_term: 1 leader_uuid: "b013ba80ae67498e93fd609741af40b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } health_report { overall_health: UNKNOWN } } }
I20260812 06:13:09.726297 4222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.723957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60294 (local address 127.0.176.194:42363)
0812 06:13:09.724003 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.724005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.724015 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:09.724062 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.724063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.724072 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.724111 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:09.724194 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.724657 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.725376 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.725568 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.725628 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.726001 (+ 373us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:09.726036 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:09.726102 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.726208 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.726229 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:13:09.730990 4222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.728867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:39757 (local address 127.0.176.194:42363)
0812 06:13:09.728902 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:09.728904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:09.728913 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:09.729001 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:09.729001 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:09.729010 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:09.729055 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:09.729160 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.729625 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.730346 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.730544 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.730627 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.730754 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:09.730784 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:09.730831 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:09.730888 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 06:13:09.730906 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:13:09.730990 4300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:09.728807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:42363 (local address 127.0.176.194:39757)
0812 06:13:09.728862 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:09.728874 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:09.728922 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:09.729069 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:09.729070 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:09.729071 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:13:09.729113 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.729114 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.729707 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.729708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.730254 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:09.730255 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:09.730627 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:09.730628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:09.730679 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:09.730685 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:13:09.730835 (+ 150us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:13:09.730836 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:13:09.730876 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 06:13:09.730923 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 06:13:09.733975 4112 raft_consensus.cc:1261] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Refusing update from remote peer b013ba80ae67498e93fd609741af40b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:09.734050 3656 raft_consensus.cc:1261] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Refusing update from remote peer b013ba80ae67498e93fd609741af40b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:09.734321 4237 consensus_queue.cc:1035] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:09.734467 4296 consensus_queue.cc:1035] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:13:09.739720 4276 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 06:13:11.259831 3403 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:11.259939 3403 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:11.260802 3403 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14: Sending DeleteTablet for 3 replicas of tablet 4ffa1a6622d2455eb6d2cece082280b6
I20260812 06:13:11.261081 4080 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ffa1a6622d2455eb6d2cece082280b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:11 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:58598
I20260812 06:13:11.261089 3625 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ffa1a6622d2455eb6d2cece082280b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:11 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:48834
I20260812 06:13:11.261308 3861 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ffa1a6622d2455eb6d2cece082280b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:11 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:60278
I20260812 06:13:11.261586 4345 tablet_replica.cc:330] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1: stopping tablet replica
I20260812 06:13:11.261587 4344 tablet_replica.cc:330] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3: stopping tablet replica
I20260812 06:13:11.261667 4344 raft_consensus.cc:2229] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:11.261667 4345 raft_consensus.cc:2229] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:13:11.261715 4344 raft_consensus.cc:2258] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:11.261768 4345 raft_consensus.cc:2258] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:11.262022 4345 ts_tablet_manager.cc:1905] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:11.262125 4344 ts_tablet_manager.cc:1905] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:11.263729 4345 ts_tablet_manager.cc:1918] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:13:11.263803 4345 log.cc:1196] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/4ffa1a6622d2455eb6d2cece082280b6
I20260812 06:13:11.264091 4345 ts_tablet_manager.cc:1939] T 4ffa1a6622d2455eb6d2cece082280b6 P b013ba80ae67498e93fd609741af40b1: Deleting consensus metadata
I20260812 06:13:11.264120 4344 ts_tablet_manager.cc:1918] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:13:11.264200 4344 log.cc:1196] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/wal/wals/4ffa1a6622d2455eb6d2cece082280b6
I20260812 06:13:11.264463 3391 catalog_manager.cc:4841] TS b013ba80ae67498e93fd609741af40b1 (127.0.176.194:42363): tablet 4ffa1a6622d2455eb6d2cece082280b6 (table test-table [id=f03f2b4d7dcd404ab9661a5f719efc3d]) successfully deleted
I20260812 06:13:11.264580 4343 tablet_replica.cc:330] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f: stopping tablet replica
I20260812 06:13:11.264654 4343 raft_consensus.cc:2229] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:11.264704 4344 ts_tablet_manager.cc:1939] T 4ffa1a6622d2455eb6d2cece082280b6 P a4866e3fa21044759473a1f28f1fa4c3: Deleting consensus metadata
I20260812 06:13:11.264707 4343 raft_consensus.cc:2258] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:11.264950 4343 ts_tablet_manager.cc:1905] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:11.265084 3387 catalog_manager.cc:4841] TS a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193:46759): tablet 4ffa1a6622d2455eb6d2cece082280b6 (table test-table [id=f03f2b4d7dcd404ab9661a5f719efc3d]) successfully deleted
I20260812 06:13:11.266970 4343 ts_tablet_manager.cc:1918] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:13:11.267042 4343 log.cc:1196] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/4ffa1a6622d2455eb6d2cece082280b6
I20260812 06:13:11.267294 4343 ts_tablet_manager.cc:1939] T 4ffa1a6622d2455eb6d2cece082280b6 P bd715a4306ea42ceaffa57cbd9f2c63f: Deleting consensus metadata
I20260812 06:13:11.267771 3390 catalog_manager.cc:4841] TS bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195:36607): tablet 4ffa1a6622d2455eb6d2cece082280b6 (table test-table [id=f03f2b4d7dcd404ab9661a5f719efc3d]) successfully deleted
Aug 12 06:13:11 dist-test-slave-gw5c krb5kdc[3339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515191, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:13:11 dist-test-slave-gw5c krb5kdc[3339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515191, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:11.292912 4362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:11.281183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60968 (local address 127.0.176.254:39395)
0812 06:13:11.281378 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:11.281380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:11.281473 (+ 93us) server_negotiation.cc:407] Connection header received
0812 06:13:11.281593 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:11.281594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:11.281611 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:11.281704 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:11.282340 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.282882 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.283751 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.283981 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.284069 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:11.290129 (+ 6060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:11.290131 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:11.290131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:11.290139 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:11.291639 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:11.292021 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:11.292022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:11.292022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:11.292087 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:11.292302 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:11.292303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:11.292303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:11.292428 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:11.292544 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:11.292691 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 06:13:11.292790 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":88,"threads_started":1}
I20260812 06:13:11.294500 3403 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:13:11.294690 3403 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:11.296267 3625 tablet_service.cc:1467] Processing CreateTablet for tablet 66cef01ed9224fb4ad922613db388c96 (DEFAULT_TABLE table=test-table [id=2684c2292f1f4311aeae288e7932fa1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:11.296267 3861 tablet_service.cc:1467] Processing CreateTablet for tablet 66cef01ed9224fb4ad922613db388c96 (DEFAULT_TABLE table=test-table [id=2684c2292f1f4311aeae288e7932fa1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:11.296293 4080 tablet_service.cc:1467] Processing CreateTablet for tablet 66cef01ed9224fb4ad922613db388c96 (DEFAULT_TABLE table=test-table [id=2684c2292f1f4311aeae288e7932fa1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:11.296427 3625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66cef01ed9224fb4ad922613db388c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:11.296427 3861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66cef01ed9224fb4ad922613db388c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:11.296461 4080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66cef01ed9224fb4ad922613db388c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:11.297588 4363 tablet_bootstrap.cc:492] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f: Bootstrap starting.
I20260812 06:13:11.298079 4366 tablet_bootstrap.cc:492] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1: Bootstrap starting.
I20260812 06:13:11.298136 4365 tablet_bootstrap.cc:492] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3: Bootstrap starting.
I20260812 06:13:11.298245 4363 tablet_bootstrap.cc:654] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:11.298496 4366 tablet_bootstrap.cc:654] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:11.298496 4365 tablet_bootstrap.cc:654] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:11.298935 4363 tablet_bootstrap.cc:492] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f: No bootstrap required, opened a new log
I20260812 06:13:11.299024 4363 ts_tablet_manager.cc:1397] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:11.299168 4363 raft_consensus.cc:348] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.299249 4363 raft_consensus.cc:374] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:11.299283 4363 raft_consensus.cc:729] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd715a4306ea42ceaffa57cbd9f2c63f, State: Initialized, Role: FOLLOWER
I20260812 06:13:11.299340 4363 consensus_queue.cc:260] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.299575 4363 ts_tablet_manager.cc:1428] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:11.299998 4366 tablet_bootstrap.cc:492] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1: No bootstrap required, opened a new log
I20260812 06:13:11.300064 4366 ts_tablet_manager.cc:1397] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:13:11.300104 4365 tablet_bootstrap.cc:492] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3: No bootstrap required, opened a new log
I20260812 06:13:11.300156 4365 ts_tablet_manager.cc:1397] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:13:11.300185 4366 raft_consensus.cc:348] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.300269 4366 raft_consensus.cc:374] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:11.300294 4366 raft_consensus.cc:729] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b013ba80ae67498e93fd609741af40b1, State: Initialized, Role: FOLLOWER
I20260812 06:13:11.300302 4365 raft_consensus.cc:348] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.300343 4366 consensus_queue.cc:260] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.300379 4365 raft_consensus.cc:374] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:11.300402 4365 raft_consensus.cc:729] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4866e3fa21044759473a1f28f1fa4c3, State: Initialized, Role: FOLLOWER
I20260812 06:13:11.300455 4366 ts_tablet_manager.cc:1428] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:11.300444 4365 consensus_queue.cc:260] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.300619 4365 ts_tablet_manager.cc:1428] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 06:13:11.417327 4323 raft_consensus.cc:482] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:11.417564 4323 raft_consensus.cc:504] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.417795 4323 leader_election.cc:288] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193:46759), bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195:36607)
I20260812 06:13:11.418052 3656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66cef01ed9224fb4ad922613db388c96" candidate_uuid: "b013ba80ae67498e93fd609741af40b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4866e3fa21044759473a1f28f1fa4c3" is_pre_election: true
I20260812 06:13:11.418104 4112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66cef01ed9224fb4ad922613db388c96" candidate_uuid: "b013ba80ae67498e93fd609741af40b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" is_pre_election: true
I20260812 06:13:11.418184 3656 raft_consensus.cc:2454] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b013ba80ae67498e93fd609741af40b1 in term 0.
I20260812 06:13:11.418188 4112 raft_consensus.cc:2454] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b013ba80ae67498e93fd609741af40b1 in term 0.
I20260812 06:13:11.418401 3784 leader_election.cc:302] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4866e3fa21044759473a1f28f1fa4c3, b013ba80ae67498e93fd609741af40b1; no voters:
I20260812 06:13:11.418560 4323 raft_consensus.cc:2781] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:11.418602 4323 raft_consensus.cc:482] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:11.418628 4323 raft_consensus.cc:3037] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:11.419489 4323 raft_consensus.cc:504] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.419670 4323 leader_election.cc:288] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [CANDIDATE]: Term 1 election: Requested vote from peers a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193:46759), bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195:36607)
I20260812 06:13:11.419829 3656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66cef01ed9224fb4ad922613db388c96" candidate_uuid: "b013ba80ae67498e93fd609741af40b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4866e3fa21044759473a1f28f1fa4c3"
I20260812 06:13:11.419848 4112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66cef01ed9224fb4ad922613db388c96" candidate_uuid: "b013ba80ae67498e93fd609741af40b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f"
I20260812 06:13:11.419930 4112 raft_consensus.cc:3037] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:11.419932 3656 raft_consensus.cc:3037] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:11.420585 3656 raft_consensus.cc:2454] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b013ba80ae67498e93fd609741af40b1 in term 1.
I20260812 06:13:11.420584 4112 raft_consensus.cc:2454] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b013ba80ae67498e93fd609741af40b1 in term 1.
I20260812 06:13:11.420780 3784 leader_election.cc:302] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4866e3fa21044759473a1f28f1fa4c3, b013ba80ae67498e93fd609741af40b1; no voters:
I20260812 06:13:11.420905 4323 raft_consensus.cc:2781] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:11.420965 4323 raft_consensus.cc:686] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [term 1 LEADER]: Becoming Leader. State: Replica: b013ba80ae67498e93fd609741af40b1, State: Running, Role: LEADER
I20260812 06:13:11.421032 4323 consensus_queue.cc:237] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.421792 3403 catalog_manager.cc:5495] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b013ba80ae67498e93fd609741af40b1 (127.0.176.194). New cstate: current_term: 1 leader_uuid: "b013ba80ae67498e93fd609741af40b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } health_report { overall_health: UNKNOWN } } }
I20260812 06:13:11.450562 4380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:11.448191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60310 (local address 127.0.176.194:42363)
0812 06:13:11.448363 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:11.448365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:11.448373 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:13:11.448404 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:11.448405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:11.448416 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:11.448476 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:11.448666 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.449155 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.449937 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.450129 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.450184 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:11.450320 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:11.450347 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:11.450382 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:11.450417 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 06:13:11.450433 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":120,"threads_started":1}
I20260812 06:13:11.453270 3656 raft_consensus.cc:1261] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Refusing update from remote peer b013ba80ae67498e93fd609741af40b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:11.453270 4112 raft_consensus.cc:1261] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Refusing update from remote peer b013ba80ae67498e93fd609741af40b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:11.453568 4330 consensus_queue.cc:1035] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:11.453713 4237 consensus_queue.cc:1035] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:11.464025 3403 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:11.464146 3403 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:11.464840 3403 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14: Sending DeleteTablet for 3 replicas of tablet 66cef01ed9224fb4ad922613db388c96
I20260812 06:13:11.465123 3861 tablet_service.cc:1514] Processing DeleteTablet for tablet 66cef01ed9224fb4ad922613db388c96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:11 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:60278
I20260812 06:13:11.465145 3625 tablet_service.cc:1514] Processing DeleteTablet for tablet 66cef01ed9224fb4ad922613db388c96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:11 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:48834
I20260812 06:13:11.465197 4080 tablet_service.cc:1514] Processing DeleteTablet for tablet 66cef01ed9224fb4ad922613db388c96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:11 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:58598
I20260812 06:13:11.465268 4344 tablet_replica.cc:330] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3: stopping tablet replica
I20260812 06:13:11.465297 4345 tablet_replica.cc:330] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1: stopping tablet replica
I20260812 06:13:11.465333 4344 raft_consensus.cc:2229] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:11.465368 4345 raft_consensus.cc:2229] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:13:11.465380 4344 raft_consensus.cc:2258] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:11.465436 4345 raft_consensus.cc:2258] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:11.465525 4343 tablet_replica.cc:330] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f: stopping tablet replica
I20260812 06:13:11.465575 3403 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 06:13:11.465704 4343 raft_consensus.cc:2229] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 06:13:11.465734 3403 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:11.465790 4343 raft_consensus.cc:2258] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:11.466126 4343 ts_tablet_manager.cc:1905] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:11.466236 4345 ts_tablet_manager.cc:1905] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:11.467939 4343 ts_tablet_manager.cc:1918] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:11.468004 4343 log.cc:1196] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/66cef01ed9224fb4ad922613db388c96
I20260812 06:13:11.468008 4345 ts_tablet_manager.cc:1918] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:11.468066 4345 log.cc:1196] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/66cef01ed9224fb4ad922613db388c96
I20260812 06:13:11.468176 4344 ts_tablet_manager.cc:1905] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:11.468236 4343 ts_tablet_manager.cc:1939] T 66cef01ed9224fb4ad922613db388c96 P bd715a4306ea42ceaffa57cbd9f2c63f: Deleting consensus metadata
I20260812 06:13:11.468324 4345 ts_tablet_manager.cc:1939] T 66cef01ed9224fb4ad922613db388c96 P b013ba80ae67498e93fd609741af40b1: Deleting consensus metadata
I20260812 06:13:11.468658 3391 catalog_manager.cc:4841] TS b013ba80ae67498e93fd609741af40b1 (127.0.176.194:42363): tablet 66cef01ed9224fb4ad922613db388c96 (table test-table [id=2684c2292f1f4311aeae288e7932fa1d]) successfully deleted
I20260812 06:13:11.468719 3861 tablet_service.cc:1467] Processing CreateTablet for tablet 86c5a3aa052b4d4e8f43b208c26a6272 (DEFAULT_TABLE table=test-table [id=8ef72298e630400ea95534a8df6654d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:11.468833 3861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86c5a3aa052b4d4e8f43b208c26a6272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:11.469946 4344 ts_tablet_manager.cc:1918] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:11.470019 4344 log.cc:1196] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-0/wal/wals/66cef01ed9224fb4ad922613db388c96
I20260812 06:13:11.470245 4344 ts_tablet_manager.cc:1939] T 66cef01ed9224fb4ad922613db388c96 P a4866e3fa21044759473a1f28f1fa4c3: Deleting consensus metadata
I20260812 06:13:11.470242 4366 tablet_bootstrap.cc:492] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1: Bootstrap starting.
I20260812 06:13:11.470618 3390 catalog_manager.cc:4841] TS bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195:36607): tablet 66cef01ed9224fb4ad922613db388c96 (table test-table [id=2684c2292f1f4311aeae288e7932fa1d]) successfully deleted
I20260812 06:13:11.470639 4366 tablet_bootstrap.cc:654] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:11.470728 4080 tablet_service.cc:1467] Processing CreateTablet for tablet 86c5a3aa052b4d4e8f43b208c26a6272 (DEFAULT_TABLE table=test-table [id=8ef72298e630400ea95534a8df6654d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:11.470834 4080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86c5a3aa052b4d4e8f43b208c26a6272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:11.470827 3625 tablet_service.cc:1467] Processing CreateTablet for tablet 86c5a3aa052b4d4e8f43b208c26a6272 (DEFAULT_TABLE table=test-table [id=8ef72298e630400ea95534a8df6654d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:11.470937 3625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86c5a3aa052b4d4e8f43b208c26a6272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:11.470947 3387 catalog_manager.cc:4841] TS a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193:46759): tablet 66cef01ed9224fb4ad922613db388c96 (table test-table [id=2684c2292f1f4311aeae288e7932fa1d]) successfully deleted
I20260812 06:13:11.471421 4366 tablet_bootstrap.cc:492] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1: No bootstrap required, opened a new log
I20260812 06:13:11.471472 4366 ts_tablet_manager.cc:1397] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:11.471581 4366 raft_consensus.cc:348] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.471657 4366 raft_consensus.cc:374] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:11.471683 4366 raft_consensus.cc:729] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b013ba80ae67498e93fd609741af40b1, State: Initialized, Role: FOLLOWER
I20260812 06:13:11.471740 4366 consensus_queue.cc:260] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.471832 4366 ts_tablet_manager.cc:1428] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:11.472182 4363 tablet_bootstrap.cc:492] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f: Bootstrap starting.
I20260812 06:13:11.472214 4365 tablet_bootstrap.cc:492] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3: Bootstrap starting.
I20260812 06:13:11.472510 4363 tablet_bootstrap.cc:654] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:11.472798 4365 tablet_bootstrap.cc:654] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:11.473114 4363 tablet_bootstrap.cc:492] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f: No bootstrap required, opened a new log
I20260812 06:13:11.473160 4363 ts_tablet_manager.cc:1397] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:11.473281 4363 raft_consensus.cc:348] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.473351 4363 raft_consensus.cc:374] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:11.473368 4363 raft_consensus.cc:729] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd715a4306ea42ceaffa57cbd9f2c63f, State: Initialized, Role: FOLLOWER
I20260812 06:13:11.473415 4363 consensus_queue.cc:260] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.473515 4363 ts_tablet_manager.cc:1428] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:11.473589 4365 tablet_bootstrap.cc:492] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3: No bootstrap required, opened a new log
I20260812 06:13:11.473646 4365 ts_tablet_manager.cc:1397] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:11.473795 4365 raft_consensus.cc:348] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.473874 4365 raft_consensus.cc:374] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:11.473896 4365 raft_consensus.cc:729] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4866e3fa21044759473a1f28f1fa4c3, State: Initialized, Role: FOLLOWER
I20260812 06:13:11.473937 4365 consensus_queue.cc:260] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.474040 4365 ts_tablet_manager.cc:1428] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:11.827006 4373 raft_consensus.cc:482] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:11.827168 4373 raft_consensus.cc:504] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.827785 4373 leader_election.cc:288] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b013ba80ae67498e93fd609741af40b1 (127.0.176.194:42363), bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195:36607)
I20260812 06:13:11.832257 4380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:11.828262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:48823 (local address 127.0.176.194:42363)
0812 06:13:11.828312 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:11.828314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:11.828325 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:11.828362 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:11.828363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:11.828374 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:11.828445 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:11.828729 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.829534 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.831212 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.831831 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.831925 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:11.831936 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:11.832132 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 06:13:11.832177 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:13:11.832273 4396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:11.828085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:60029 (local address 127.0.176.195:36607)
0812 06:13:11.828313 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:11.828315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:11.828326 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:11.828379 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:11.828380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:11.828390 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:11.828475 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:11.828770 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.829533 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.831212 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.831840 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.831919 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:11.831930 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:11.832132 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 06:13:11.832180 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":94,"threads_started":1}
I20260812 06:13:11.832320 4393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:11.828003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:36607 (local address 127.0.176.193:60029)
0812 06:13:11.828225 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:11.828234 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:11.828277 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:11.828474 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:11.828475 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:11.828476 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:11.828579 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:11.828582 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.829655 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.829656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:11.831089 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:11.831090 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.831947 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.831949 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:11.832037 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:11.832043 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:13:11.832110 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:13:11.832175 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":104,"thread_start_us":101,"threads_started":1}
I20260812 06:13:11.832336 4394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:11.827994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:42363 (local address 127.0.176.193:48823)
0812 06:13:11.828190 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:11.828204 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:11.828272 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:11.828470 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:11.828471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:11.828473 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:11.828579 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:11.828582 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.829631 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.829633 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:11.831084 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:11.831090 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.831949 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.831950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:11.832042 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:11.832045 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:11.832110 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 06:13:11.832175 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":77,"thread_start_us":102,"threads_started":1}
I20260812 06:13:11.832726 4112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86c5a3aa052b4d4e8f43b208c26a6272" candidate_uuid: "a4866e3fa21044759473a1f28f1fa4c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" is_pre_election: true
I20260812 06:13:11.832837 4112 raft_consensus.cc:2454] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4866e3fa21044759473a1f28f1fa4c3 in term 0.
I20260812 06:13:11.833061 3897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86c5a3aa052b4d4e8f43b208c26a6272" candidate_uuid: "a4866e3fa21044759473a1f28f1fa4c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b013ba80ae67498e93fd609741af40b1" is_pre_election: true
I20260812 06:13:11.833170 3897 raft_consensus.cc:2454] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4866e3fa21044759473a1f28f1fa4c3 in term 0.
I20260812 06:13:11.833117 3552 leader_election.cc:302] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4866e3fa21044759473a1f28f1fa4c3, bd715a4306ea42ceaffa57cbd9f2c63f; no voters:
I20260812 06:13:11.833284 4373 raft_consensus.cc:2781] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:11.833338 4373 raft_consensus.cc:482] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:11.833371 4373 raft_consensus.cc:3037] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:11.834242 4373 raft_consensus.cc:504] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.834430 4373 leader_election.cc:288] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [CANDIDATE]: Term 1 election: Requested vote from peers b013ba80ae67498e93fd609741af40b1 (127.0.176.194:42363), bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195:36607)
I20260812 06:13:11.834656 4112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86c5a3aa052b4d4e8f43b208c26a6272" candidate_uuid: "a4866e3fa21044759473a1f28f1fa4c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f"
I20260812 06:13:11.834653 3897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86c5a3aa052b4d4e8f43b208c26a6272" candidate_uuid: "a4866e3fa21044759473a1f28f1fa4c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b013ba80ae67498e93fd609741af40b1"
I20260812 06:13:11.834746 3897 raft_consensus.cc:3037] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:11.834748 4112 raft_consensus.cc:3037] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:11.835625 3897 raft_consensus.cc:2454] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4866e3fa21044759473a1f28f1fa4c3 in term 1.
I20260812 06:13:11.835625 4112 raft_consensus.cc:2454] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4866e3fa21044759473a1f28f1fa4c3 in term 1.
I20260812 06:13:11.835827 3552 leader_election.cc:302] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4866e3fa21044759473a1f28f1fa4c3, bd715a4306ea42ceaffa57cbd9f2c63f; no voters:
I20260812 06:13:11.835940 4373 raft_consensus.cc:2781] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:11.836145 4373 raft_consensus.cc:686] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [term 1 LEADER]: Becoming Leader. State: Replica: a4866e3fa21044759473a1f28f1fa4c3, State: Running, Role: LEADER
I20260812 06:13:11.836247 4373 consensus_queue.cc:237] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } }
I20260812 06:13:11.837049 3403 catalog_manager.cc:5495] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193). New cstate: current_term: 1 leader_uuid: "a4866e3fa21044759473a1f28f1fa4c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4866e3fa21044759473a1f28f1fa4c3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 46759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 } health_report { overall_health: UNKNOWN } } }
I20260812 06:13:11.917425 4399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:11.914758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48838 (local address 127.0.176.193:46759)
0812 06:13:11.914966 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:11.914968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:11.914974 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:13:11.915014 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:11.915014 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:11.915036 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:11.915136 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:11.915259 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.915846 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.916605 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.916818 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.916907 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:11.917044 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:11.917160 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:11.917244 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:11.917285 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 06:13:11.917306 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":116,"threads_started":1}
I20260812 06:13:11.922425 4380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:11.920093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:45765 (local address 127.0.176.194:42363)
0812 06:13:11.920145 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:11.920147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:11.920216 (+ 69us) server_negotiation.cc:407] Connection header received
0812 06:13:11.920272 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:11.920273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:11.920286 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:11.920332 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:11.920456 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.920934 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.921794 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.921996 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.922055 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:11.922218 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:11.922246 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:11.922285 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:11.922339 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 06:13:11.922363 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:13:11.922451 4402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:11.919998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:42363 (local address 127.0.176.193:45765)
0812 06:13:11.920158 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:11.920174 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:11.920229 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:11.920346 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:11.920347 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:11.920349 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:13:11.920408 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:11.920409 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.921005 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.921006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:11.921686 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:11.921689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.922068 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.922069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:11.922125 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:11.922141 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:13:11.922298 (+ 157us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:13:11.922300 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:13:11.922331 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 06:13:11.922376 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260812 06:13:11.925091 4112 raft_consensus.cc:1261] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Refusing update from remote peer a4866e3fa21044759473a1f28f1fa4c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:11.925117 3897 raft_consensus.cc:1261] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Refusing update from remote peer a4866e3fa21044759473a1f28f1fa4c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:11.925801 4397 consensus_queue.cc:1035] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b013ba80ae67498e93fd609741af40b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 42363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:11.925973 4373 consensus_queue.cc:1035] T 86c5a3aa052b4d4e8f43b208c26a6272 P a4866e3fa21044759473a1f28f1fa4c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd715a4306ea42ceaffa57cbd9f2c63f" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:11.935658 4407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:11.932779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:46759 (local address 127.0.176.194:35203)
0812 06:13:11.933015 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:11.933026 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:11.933087 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:11.933231 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:11.933232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:11.933233 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:13:11.933291 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:11.933293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.933965 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.933966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:11.934646 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:11.934649 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.935180 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.935181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:11.935250 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:11.935257 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:13:11.935471 (+ 214us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:13:11.935474 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:11.935522 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:13:11.935577 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":116,"threads_started":1}
I20260812 06:13:11.935629 4399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:11.932820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:35203 (local address 127.0.176.193:46759)
0812 06:13:11.932866 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:11.932868 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:11.933072 (+ 204us) server_negotiation.cc:407] Connection header received
0812 06:13:11.933149 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:11.933150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:11.933171 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:11.933228 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:11.933362 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.933864 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.934732 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:11.935095 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:11.935181 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:11.935347 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:11.935384 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:11.935471 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:11.935523 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 06:13:11.935548 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 06:13:11.936194 4325 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 06:13:13.464191 3403 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:13.464326 3403 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:13.465679 3403 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 05bf4673441b4342ac3bac1109292d14: Sending DeleteTablet for 3 replicas of tablet 86c5a3aa052b4d4e8f43b208c26a6272
I20260812 06:13:13.466032 3625 tablet_service.cc:1514] Processing DeleteTablet for tablet 86c5a3aa052b4d4e8f43b208c26a6272 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:13 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:48834
I20260812 06:13:13.466151 4080 tablet_service.cc:1514] Processing DeleteTablet for tablet 86c5a3aa052b4d4e8f43b208c26a6272 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:13 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:58598
I20260812 06:13:13.466205 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 3526
I20260812 06:13:13.466815 3861 tablet_service.cc:1514] Processing DeleteTablet for tablet 86c5a3aa052b4d4e8f43b208c26a6272 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:13 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:60278
I20260812 06:13:13.473527 4437 tablet_replica.cc:330] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f: stopping tablet replica
I20260812 06:13:13.473644 4437 raft_consensus.cc:2229] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:13.473701 4437 raft_consensus.cc:2258] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:13.476123 4437 ts_tablet_manager.cc:1905] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:13.479211 4441 tablet_replica.cc:330] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1: stopping tablet replica
I20260812 06:13:13.479177 4437 ts_tablet_manager.cc:1918] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:13:13.479318 4437 log.cc:1196] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/86c5a3aa052b4d4e8f43b208c26a6272
I20260812 06:13:13.479558 4441 raft_consensus.cc:2229] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:13.479635 4437 ts_tablet_manager.cc:1939] T 86c5a3aa052b4d4e8f43b208c26a6272 P bd715a4306ea42ceaffa57cbd9f2c63f: Deleting consensus metadata
I20260812 06:13:13.479741 4441 raft_consensus.cc:2258] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:13.480123 3390 catalog_manager.cc:4841] TS bd715a4306ea42ceaffa57cbd9f2c63f (127.0.176.195:36607): tablet 86c5a3aa052b4d4e8f43b208c26a6272 (table test-table [id=8ef72298e630400ea95534a8df6654d2]) successfully deleted
I20260812 06:13:13.480340 4441 ts_tablet_manager.cc:1905] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:13.482497 4441 ts_tablet_manager.cc:1918] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:13:13.482585 4441 log.cc:1196] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/86c5a3aa052b4d4e8f43b208c26a6272
I20260812 06:13:13.482823 4441 ts_tablet_manager.cc:1939] T 86c5a3aa052b4d4e8f43b208c26a6272 P b013ba80ae67498e93fd609741af40b1: Deleting consensus metadata
I20260812 06:13:13.483295 3391 catalog_manager.cc:4841] TS b013ba80ae67498e93fd609741af40b1 (127.0.176.194:42363): tablet 86c5a3aa052b4d4e8f43b208c26a6272 (table test-table [id=8ef72298e630400ea95534a8df6654d2]) successfully deleted
W20260812 06:13:13.487052 3387 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:46759 (error 108)
I20260812 06:13:13.487337 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 3756
I20260812 06:13:13.512455 4443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:13.509926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:46759 (local address 127.0.0.1:48852)
0812 06:13:13.512299 (+ 2373us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:13.512402 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:46759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2328,"thread_start_us":1020,"threads_started":1}
W20260812 06:13:13.512683 3387 catalog_manager.cc:4584] TS a4866e3fa21044759473a1f28f1fa4c3 (127.0.176.193:46759): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 86c5a3aa052b4d4e8f43b208c26a6272: Network error: Client connection negotiation failed: client connection to 127.0.176.193:46759: connect: Connection refused (error 111)
I20260812 06:13:13.518455 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 3978
I20260812 06:13:13.538004 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 3362
2026-08-12T06:13:13Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6554 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:13:13 dist-test-slave-gw5c krb5kdc[4447](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:13:13 dist-test-slave-gw5c krb5kdc[4447](info): set up 2 sockets
Aug 12 06:13:13 dist-test-slave-gw5c krb5kdc[4447](info): commencing operation
krb5kdc: starting...
W20260812 06:13:14.828776 707 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:14 dist-test-slave-gw5c krb5kdc[4447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:13:14.966892 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:34189
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:43769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:34189
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:15.054176 4463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:15.054457 4463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:15.054499 4463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:15.055743 4463 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:15.055830 4463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:15.055861 4463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:15.055893 4463 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:15.055927 4463 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:15.057521 4463 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:43769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:34189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:34189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:15.057832 4463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:15.058082 4463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:15.063376 4476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:15.063365 4471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:15.063416 4463 server_base.cc:1034] running on GCE node
W20260812 06:13:15.063364 4469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:15.063979 4463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:15.064312 4463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:15.065505 4463 hybrid_clock.cc:648] HybridClock initialized: now 1786515195065481 us; error 38 us; skew 500 ppm
Aug 12 06:13:15 dist-test-slave-gw5c krb5kdc[4447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515195, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:15.069517 4463 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:13:15.070094 4463 webserver.cc:460] Webserver started at http://127.0.176.254:37557/ using document root <none> and password file <none>
I20260812 06:13:15.070355 4463 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:15.070427 4463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:15.070575 4463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:15.071798 4463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "77d58a84ace04374bac8120145318b4c"
format_stamp: "Formatted at 2026-08-12 06:13:15 on dist-test-slave-gw5c"
server_key: "bf388608770e0c6b031c5fd2bde5affe"
server_key_iv: "dc5a3fd8a41c63c193f347f50c580a50"
server_key_version: "encryptionkey@0"
I20260812 06:13:15.072196 4463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "77d58a84ace04374bac8120145318b4c"
format_stamp: "Formatted at 2026-08-12 06:13:15 on dist-test-slave-gw5c"
server_key: "bf388608770e0c6b031c5fd2bde5affe"
server_key_iv: "dc5a3fd8a41c63c193f347f50c580a50"
server_key_version: "encryptionkey@0"
I20260812 06:13:15.073675 4463 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:13:15.074536 4487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:15.074890 4463 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:15.075163 4463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "77d58a84ace04374bac8120145318b4c"
format_stamp: "Formatted at 2026-08-12 06:13:15 on dist-test-slave-gw5c"
server_key: "bf388608770e0c6b031c5fd2bde5affe"
server_key_iv: "dc5a3fd8a41c63c193f347f50c580a50"
server_key_version: "encryptionkey@0"
I20260812 06:13:15.075284 4463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:15.090590 4463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:15.093164 4463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:15.093394 4463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:15.097898 4463 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:34189
I20260812 06:13:15.097937 4574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:34189 every 8 connection(s)
I20260812 06:13:15.098485 4463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:15.099227 4577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:15.101641 4577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c: Bootstrap starting.
I20260812 06:13:15.102252 4577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:15.102515 4577 log.cc:824] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:15.103235 4577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c: No bootstrap required, opened a new log
I20260812 06:13:15.103580 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 4463
I20260812 06:13:15.103681 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:15.103866 707 external_mini_cluster.cc:1428] Setting key 9512ac225d242641293675f897cf85d4
I20260812 06:13:15.105989 4577 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d58a84ace04374bac8120145318b4c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34189 } }
I20260812 06:13:15.106173 4577 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:15.106251 4577 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d58a84ace04374bac8120145318b4c, State: Initialized, Role: FOLLOWER
I20260812 06:13:15.106451 4577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d58a84ace04374bac8120145318b4c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34189 } }
I20260812 06:13:15.106557 4577 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:15.106592 4577 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:15.106760 4577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:15.107614 4577 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d58a84ace04374bac8120145318b4c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34189 } }
I20260812 06:13:15.107753 4577 leader_election.cc:302] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77d58a84ace04374bac8120145318b4c; no voters:
I20260812 06:13:15.107960 4577 leader_election.cc:288] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:15.108026 4585 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:15.108229 4585 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [term 1 LEADER]: Becoming Leader. State: Replica: 77d58a84ace04374bac8120145318b4c, State: Running, Role: LEADER
I20260812 06:13:15.108256 4577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:15.108403 4585 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d58a84ace04374bac8120145318b4c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34189 } }
I20260812 06:13:15.108898 4587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77d58a84ace04374bac8120145318b4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d58a84ace04374bac8120145318b4c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34189 } } }
I20260812 06:13:15.108996 4587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:15.109385 4588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77d58a84ace04374bac8120145318b4c. Latest consensus state: current_term: 1 leader_uuid: "77d58a84ace04374bac8120145318b4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d58a84ace04374bac8120145318b4c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34189 } } }
I20260812 06:13:15.109571 4588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:15.109928 4597 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:15.110598 4597 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:15.112326 4597 catalog_manager.cc:1347] Generated new cluster ID: eb8dc713743f472d8eaae417a37ad0c9
I20260812 06:13:15.112387 4597 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:13:15 dist-test-slave-gw5c krb5kdc[4447](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:15.117960 4581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:15.104468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47666 (local address 127.0.176.254:34189)
0812 06:13:15.104766 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:15.104774 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:15.104814 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:13:15.105976 (+ 1162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:15.105984 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:15.106041 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:15.106215 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:15.107177 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.108645 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.109844 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.110480 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.110597 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:15.113580 (+ 2983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:15.113584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:15.113584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:15.113597 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:15.115651 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:15.116081 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:15.116084 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:15.116085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:15.116628 (+ 543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:15.116883 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:15.116883 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:15.116884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:15.117204 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:15.117359 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:15.117491 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 06:13:15.117633 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":113,"threads_started":1}
I20260812 06:13:15.124563 4597 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:15.125150 4597 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:15.131001 4597 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77d58a84ace04374bac8120145318b4c: Generated new TSK 0
I20260812 06:13:15.131227 4597 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:13:15.160451 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:34189
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:43769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:15.249007 4617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:15.249293 4617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:15.249338 4617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:15.250586 4617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:15.250661 4617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:15.250710 4617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:15.252468 4617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:43769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:34189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:15.252761 4617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:15.253011 4617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:15.258255 4629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:15.258272 4628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:15.258411 4617 server_base.cc:1034] running on GCE node
W20260812 06:13:15.258484 4631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:15.258703 4617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:15.258944 4617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:15.260133 4617 hybrid_clock.cc:648] HybridClock initialized: now 1786515195260115 us; error 28 us; skew 500 ppm
Aug 12 06:13:15 dist-test-slave-gw5c krb5kdc[4447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515195, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:15.262821 4617 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:13:15.263367 4617 webserver.cc:460] Webserver started at http://127.0.176.193:35401/ using document root <none> and password file <none>
I20260812 06:13:15.263666 4617 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:15.263715 4617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:15.263823 4617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:15.264883 4617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "b8c15a140bd54445ac1c81c6b5622ef8"
format_stamp: "Formatted at 2026-08-12 06:13:15 on dist-test-slave-gw5c"
server_key: "e4db091093d1cd3ed4a38719a4f30495"
server_key_iv: "968e434e0fa291ccef441130c41188fd"
server_key_version: "encryptionkey@0"
I20260812 06:13:15.265205 4617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "b8c15a140bd54445ac1c81c6b5622ef8"
format_stamp: "Formatted at 2026-08-12 06:13:15 on dist-test-slave-gw5c"
server_key: "e4db091093d1cd3ed4a38719a4f30495"
server_key_iv: "968e434e0fa291ccef441130c41188fd"
server_key_version: "encryptionkey@0"
I20260812 06:13:15.266634 4617 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:15.267429 4643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:15.267625 4617 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:15.267728 4617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "b8c15a140bd54445ac1c81c6b5622ef8"
format_stamp: "Formatted at 2026-08-12 06:13:15 on dist-test-slave-gw5c"
server_key: "e4db091093d1cd3ed4a38719a4f30495"
server_key_iv: "968e434e0fa291ccef441130c41188fd"
server_key_version: "encryptionkey@0"
I20260812 06:13:15.267822 4617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:15.292955 4617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:15.295099 4617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:15.295281 4617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:15.295571 4617 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:15.295902 4617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:15.295954 4617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:15.295995 4617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:15.296033 4617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:15.302201 4617 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:45915
I20260812 06:13:15.302249 4832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:45915 every 8 connection(s)
I20260812 06:13:15.302585 4617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:15.307320 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 4617
I20260812 06:13:15.307490 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:15.307747 707 external_mini_cluster.cc:1428] Setting key cef1233ab9fbe714fe89ad338ed92ebf
Aug 12 06:13:15 dist-test-slave-gw5c krb5kdc[4447](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515195, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:15.313361 4581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:15.303427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:50373 (local address 127.0.176.254:34189)
0812 06:13:15.303502 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:15.303504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:15.303689 (+ 185us) server_negotiation.cc:407] Connection header received
0812 06:13:15.304702 (+ 1013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:15.304703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:15.304722 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:15.304776 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:15.305437 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.305951 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.306997 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.307242 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.307325 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:15.310248 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:15.310249 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:15.310250 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:15.310262 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:15.311871 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:15.312332 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:15.312333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:15.312333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:15.312397 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:15.312660 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:15.312661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:15.312661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:15.312794 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:15.312876 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:15.313168 (+ 292us) server_negotiation.cc:299] Negotiation successful
0812 06:13:15.313264 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 06:13:15.313577 4835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:15.303348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34189 (local address 127.0.176.193:50373)
0812 06:13:15.303556 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:15.303605 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:15.304586 (+ 981us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:15.304857 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:15.304861 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:15.305142 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:15.305336 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:15.305340 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.306056 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.306057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:15.306888 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:15.306890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.307336 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.307337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:15.307506 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:15.308228 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:15.308238 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:15.310140 (+ 1902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:15.311977 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:15.311986 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:15.311988 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:15.312244 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:15.312469 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:15.312470 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:15.312470 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:15.312592 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:15.312866 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:15.312874 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:15.313027 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 06:13:15.313134 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 06:13:15.313318 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":118,"threads_started":1}
I20260812 06:13:15.314043 4833 heartbeater.cc:347] Connected to a master server at 127.0.176.254:34189
I20260812 06:13:15.314170 4833 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:15.314357 4833 heartbeater.cc:511] Master 127.0.176.254:34189 requested a full tablet report, sending...
I20260812 06:13:15.314911 4519 ts_manager.cc:194] Registered new tserver with Master: b8c15a140bd54445ac1c81c6b5622ef8 (127.0.176.193:45915)
I20260812 06:13:15.315629 4519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:50373
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:13:15.335681 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:34189
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:43769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:15.424906 4843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:15.425130 4843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:15.425155 4843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:15.426368 4843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:15.426415 4843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:15.426443 4843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:15.428079 4843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:43769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:34189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:15.428357 4843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:15.428622 4843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:15.434644 4853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:15.434630 4850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:15.434630 4849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:15.434878 4843 server_base.cc:1034] running on GCE node
I20260812 06:13:15.435262 4843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:15.435581 4843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:15.436767 4843 hybrid_clock.cc:648] HybridClock initialized: now 1786515195436746 us; error 38 us; skew 500 ppm
Aug 12 06:13:15 dist-test-slave-gw5c krb5kdc[4447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515195, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:15.439548 4843 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:13:15.440030 4843 webserver.cc:460] Webserver started at http://127.0.176.194:45783/ using document root <none> and password file <none>
I20260812 06:13:15.440299 4843 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:15.440371 4843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:15.440526 4843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:15.441668 4843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "381f03cd76344e8c884906edfb697e1e"
format_stamp: "Formatted at 2026-08-12 06:13:15 on dist-test-slave-gw5c"
server_key: "79e58d7fd404bc17a4bffc24b1a12ee8"
server_key_iv: "7e97dbaa0363effba9145550f440f895"
server_key_version: "encryptionkey@0"
I20260812 06:13:15.442049 4843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "381f03cd76344e8c884906edfb697e1e"
format_stamp: "Formatted at 2026-08-12 06:13:15 on dist-test-slave-gw5c"
server_key: "79e58d7fd404bc17a4bffc24b1a12ee8"
server_key_iv: "7e97dbaa0363effba9145550f440f895"
server_key_version: "encryptionkey@0"
I20260812 06:13:15.443550 4843 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:15.444392 4863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:15.444590 4843 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:15.444695 4843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "381f03cd76344e8c884906edfb697e1e"
format_stamp: "Formatted at 2026-08-12 06:13:15 on dist-test-slave-gw5c"
server_key: "79e58d7fd404bc17a4bffc24b1a12ee8"
server_key_iv: "7e97dbaa0363effba9145550f440f895"
server_key_version: "encryptionkey@0"
I20260812 06:13:15.444784 4843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:15.457473 4843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:15.460244 4843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:15.460467 4843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:15.460783 4843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:15.461131 4843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:15.461191 4843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:15.461239 4843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:15.461282 4843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:15.467867 4843 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:40635
I20260812 06:13:15.467947 5032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:40635 every 8 connection(s)
I20260812 06:13:15.468362 4843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:13:15.472095 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 4843
I20260812 06:13:15.472237 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:13:15.472457 707 external_mini_cluster.cc:1428] Setting key 53cfa755fe2e963d8e95d60e9b8b04c2
Aug 12 06:13:15 dist-test-slave-gw5c krb5kdc[4447](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515195, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:15.480450 4581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:15.469213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:39797 (local address 127.0.176.254:34189)
0812 06:13:15.469316 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:15.469320 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:15.469510 (+ 190us) server_negotiation.cc:407] Connection header received
0812 06:13:15.470543 (+ 1033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:15.470544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:15.470556 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:15.470663 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:15.471323 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.471985 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.473309 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.473619 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.473697 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:15.476311 (+ 2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:15.476314 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:15.476314 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:15.476324 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:15.478357 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:15.479066 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:15.479068 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:15.479068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:15.479144 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:15.479555 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:15.479556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:15.479556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:15.479787 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:15.479914 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:15.480232 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 06:13:15.480345 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 06:13:15.480705 5038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:15.469177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34189 (local address 127.0.176.194:39797)
0812 06:13:15.469371 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:15.469421 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:15.470404 (+ 983us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:15.470736 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:15.470739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:15.471029 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:15.471234 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:15.471239 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.472120 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.472122 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:15.473242 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:15.473245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.473716 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.473716 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:15.473828 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:15.474491 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:15.474502 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:15.476199 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:15.478481 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:15.478494 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:15.478497 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:15.478896 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:15.479227 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:15.479228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:15.479228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:15.479479 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:15.479903 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:15.479912 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:15.480084 (+ 172us) client_negotiation.cc:769] Sending connection context
0812 06:13:15.480210 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 06:13:15.480419 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":100,"threads_started":1}
I20260812 06:13:15.481186 5033 heartbeater.cc:347] Connected to a master server at 127.0.176.254:34189
I20260812 06:13:15.481297 5033 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:15.481549 5033 heartbeater.cc:511] Master 127.0.176.254:34189 requested a full tablet report, sending...
I20260812 06:13:15.481998 4519 ts_manager.cc:194] Registered new tserver with Master: 381f03cd76344e8c884906edfb697e1e (127.0.176.194:40635)
I20260812 06:13:15.482414 4519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:39797
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:13:15.502703 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:34189
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:43769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:15.590111 5042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:15.590384 5042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:15.590413 5042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:15.591825 5042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:15.591892 5042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:15.591924 5042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:15.593798 5042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:43769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:34189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:15.594094 5042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:15.594395 5042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:15.600257 5054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:15.600257 5049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:15.600334 5050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:15.600492 5042 server_base.cc:1034] running on GCE node
I20260812 06:13:15.600781 5042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:15.601082 5042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:15.602327 5042 hybrid_clock.cc:648] HybridClock initialized: now 1786515195602299 us; error 51 us; skew 500 ppm
Aug 12 06:13:15 dist-test-slave-gw5c krb5kdc[4447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515195, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:15.605329 5042 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:13:15.605832 5042 webserver.cc:460] Webserver started at http://127.0.176.195:41137/ using document root <none> and password file <none>
I20260812 06:13:15.606048 5042 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:15.606096 5042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:15.606204 5042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:15.607368 5042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "8174774b9809451eb5aeac72618330bf"
format_stamp: "Formatted at 2026-08-12 06:13:15 on dist-test-slave-gw5c"
server_key: "d734be18db7be0773cc33f285ddd7de7"
server_key_iv: "7477e59908f96d3b2633097acaa9b26a"
server_key_version: "encryptionkey@0"
I20260812 06:13:15.607820 5042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "8174774b9809451eb5aeac72618330bf"
format_stamp: "Formatted at 2026-08-12 06:13:15 on dist-test-slave-gw5c"
server_key: "d734be18db7be0773cc33f285ddd7de7"
server_key_iv: "7477e59908f96d3b2633097acaa9b26a"
server_key_version: "encryptionkey@0"
I20260812 06:13:15.609580 5042 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 06:13:15.610556 5065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:15.610867 5042 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:15.610994 5042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "8174774b9809451eb5aeac72618330bf"
format_stamp: "Formatted at 2026-08-12 06:13:15 on dist-test-slave-gw5c"
server_key: "d734be18db7be0773cc33f285ddd7de7"
server_key_iv: "7477e59908f96d3b2633097acaa9b26a"
server_key_version: "encryptionkey@0"
I20260812 06:13:15.611096 5042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:15.623121 5042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:15.625756 5042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:15.625936 5042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:15.626232 5042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:15.626598 5042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:15.626731 5042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:15.626832 5042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:15.626865 5042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:15.634146 5042 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:39829
I20260812 06:13:15.634249 5244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:39829 every 8 connection(s)
I20260812 06:13:15.634572 5042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:13:15.639418 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 5042
I20260812 06:13:15.639533 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:13:15.639757 707 external_mini_cluster.cc:1428] Setting key fd1e9432f151ca5d16e9150277f757cd
Aug 12 06:13:15 dist-test-slave-gw5c krb5kdc[4447](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515195, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:15.644795 4581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:15.635445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:58917 (local address 127.0.176.254:34189)
0812 06:13:15.635507 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:15.635510 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:15.635738 (+ 228us) server_negotiation.cc:407] Connection header received
0812 06:13:15.636685 (+ 947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:15.636686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:15.636696 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:15.636761 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:15.637390 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.637890 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.638896 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.639092 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.639149 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:15.641923 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:15.641925 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:15.641926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:15.641935 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:15.643246 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:15.643741 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:15.643743 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:15.643743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:15.643809 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:15.644085 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:15.644085 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:15.644086 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:15.644223 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:15.644298 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:15.644605 (+ 307us) server_negotiation.cc:299] Negotiation successful
0812 06:13:15.644698 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:13:15.645056 5247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:15.635377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34189 (local address 127.0.176.195:58917)
0812 06:13:15.635592 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:15.635640 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:15.636586 (+ 946us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:15.636817 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:15.636821 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:15.637100 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:15.637310 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:15.637314 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.637978 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.637979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:15.638809 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:15.638811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:15.639203 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:15.639204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:15.639385 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:15.640056 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:15.640066 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:15.641809 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:15.643346 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:15.643356 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:15.643359 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:15.643648 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:15.643878 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:15.643879 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:15.643880 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:15.644006 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:15.644300 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:15.644308 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:15.644464 (+ 156us) client_negotiation.cc:769] Sending connection context
0812 06:13:15.644569 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 06:13:15.644746 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":134,"threads_started":1}
I20260812 06:13:15.645601 5245 heartbeater.cc:347] Connected to a master server at 127.0.176.254:34189
I20260812 06:13:15.645711 5245 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:15.645875 5245 heartbeater.cc:511] Master 127.0.176.254:34189 requested a full tablet report, sending...
I20260812 06:13:15.646268 4519 ts_manager.cc:194] Registered new tserver with Master: 8174774b9809451eb5aeac72618330bf (127.0.176.195:39829)
I20260812 06:13:15.646631 4519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:58917
I20260812 06:13:15.651937 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 06:13:15.666323 4581 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:15.664697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47672 (local address 127.0.176.254:34189)
0812 06:13:15.664795 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:15.664797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:15.664910 (+ 113us) server_negotiation.cc:407] Connection header received
0812 06:13:15.665011 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:15.665012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:15.665023 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:15.665100 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:15.666209 (+ 1109us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47672: BlockingRecv error: recv got EOF from 127.0.0.1:47672 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 06:13:15.667693 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 4617
I20260812 06:13:15.709836 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 4843
I20260812 06:13:15.725549 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 5042
I20260812 06:13:15.738713 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 4463
2026-08-12T06:13:15Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2194 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:13:15 dist-test-slave-gw5c krb5kdc[5270](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:13:15 dist-test-slave-gw5c krb5kdc[5270](info): set up 2 sockets
Aug 12 06:13:15 dist-test-slave-gw5c krb5kdc[5270](info): commencing operation
krb5kdc: starting...
W20260812 06:13:17.010901 707 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:17 dist-test-slave-gw5c krb5kdc[5270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:13:17.139182 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:44347
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:37665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:44347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:17.229001 5290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:17.229238 5290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:17.229264 5290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:17.230482 5290 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:17.230521 5290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:17.230536 5290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:17.230549 5290 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:17.230562 5290 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:17.232123 5290 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:37665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:44347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:44347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:17.232338 5290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:17.232528 5290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:17.237586 5300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:17.237605 5303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:17.237603 5298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:17.237874 5290 server_base.cc:1034] running on GCE node
I20260812 06:13:17.238132 5290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:17.238483 5290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:17.239686 5290 hybrid_clock.cc:648] HybridClock initialized: now 1786515197239672 us; error 33 us; skew 500 ppm
Aug 12 06:13:17 dist-test-slave-gw5c krb5kdc[5270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515197, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:17.248100 5290 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:13:17.248703 5290 webserver.cc:460] Webserver started at http://127.0.176.254:37075/ using document root <none> and password file <none>
I20260812 06:13:17.248978 5290 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:17.249053 5290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:17.249212 5290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:17.250402 5290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "507aa0d2b68e4e9ea1a2e7d1303e2c89"
format_stamp: "Formatted at 2026-08-12 06:13:17 on dist-test-slave-gw5c"
server_key: "c2ecb97d5cb9df4c74b5769c0d3d2dc6"
server_key_iv: "4f1f99e9874b36fb33a4d027df5e6901"
server_key_version: "encryptionkey@0"
I20260812 06:13:17.250797 5290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "507aa0d2b68e4e9ea1a2e7d1303e2c89"
format_stamp: "Formatted at 2026-08-12 06:13:17 on dist-test-slave-gw5c"
server_key: "c2ecb97d5cb9df4c74b5769c0d3d2dc6"
server_key_iv: "4f1f99e9874b36fb33a4d027df5e6901"
server_key_version: "encryptionkey@0"
I20260812 06:13:17.252322 5290 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:17.253158 5312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:17.253372 5290 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:17.253499 5290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "507aa0d2b68e4e9ea1a2e7d1303e2c89"
format_stamp: "Formatted at 2026-08-12 06:13:17 on dist-test-slave-gw5c"
server_key: "c2ecb97d5cb9df4c74b5769c0d3d2dc6"
server_key_iv: "4f1f99e9874b36fb33a4d027df5e6901"
server_key_version: "encryptionkey@0"
I20260812 06:13:17.253580 5290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:17.276207 5290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:17.278497 5290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:17.278693 5290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:17.283278 5290 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:44347
I20260812 06:13:17.283320 5395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:44347 every 8 connection(s)
I20260812 06:13:17.283731 5290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:17.284716 5396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:17.285569 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 5290
I20260812 06:13:17.285739 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:17.285943 707 external_mini_cluster.cc:1428] Setting key e8c693577693f5665e9f5cb6271707ec
I20260812 06:13:17.288398 5396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89: Bootstrap starting.
I20260812 06:13:17.289203 5396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:17.289539 5396 log.cc:824] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:17.290278 5396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89: No bootstrap required, opened a new log
I20260812 06:13:17.292457 5396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "507aa0d2b68e4e9ea1a2e7d1303e2c89" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44347 } }
I20260812 06:13:17.292603 5396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:17.292627 5396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 507aa0d2b68e4e9ea1a2e7d1303e2c89, State: Initialized, Role: FOLLOWER
I20260812 06:13:17.292778 5396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "507aa0d2b68e4e9ea1a2e7d1303e2c89" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44347 } }
I20260812 06:13:17.292886 5396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:17.292932 5396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:17.293005 5396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [term 0 FOLLOWER]: Advancing to term 1
Aug 12 06:13:17 dist-test-slave-gw5c krb5kdc[5270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:17.293707 5396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "507aa0d2b68e4e9ea1a2e7d1303e2c89" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44347 } }
I20260812 06:13:17.293845 5396 leader_election.cc:302] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 507aa0d2b68e4e9ea1a2e7d1303e2c89; no voters:
I20260812 06:13:17.294045 5396 leader_election.cc:288] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:17.294118 5404 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:17.294294 5404 raft_consensus.cc:686] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [term 1 LEADER]: Becoming Leader. State: Replica: 507aa0d2b68e4e9ea1a2e7d1303e2c89, State: Running, Role: LEADER
I20260812 06:13:17.294353 5396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:17.294399 5404 consensus_queue.cc:237] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "507aa0d2b68e4e9ea1a2e7d1303e2c89" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44347 } }
I20260812 06:13:17.294744 5405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "507aa0d2b68e4e9ea1a2e7d1303e2c89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "507aa0d2b68e4e9ea1a2e7d1303e2c89" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44347 } } }
I20260812 06:13:17.294847 5405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:17.295043 5406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 507aa0d2b68e4e9ea1a2e7d1303e2c89. Latest consensus state: current_term: 1 leader_uuid: "507aa0d2b68e4e9ea1a2e7d1303e2c89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "507aa0d2b68e4e9ea1a2e7d1303e2c89" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44347 } } }
I20260812 06:13:17.295117 5406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:17.295254 5412 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:17.295821 5412 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:17.297871 5412 catalog_manager.cc:1347] Generated new cluster ID: 6704e7b5f7814b6eae467bd2cb5f83fc
I20260812 06:13:17.297927 5412 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:17.298557 5401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:17.286579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45108 (local address 127.0.176.254:44347)
0812 06:13:17.286825 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:17.286835 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:17.286870 (+ 35us) server_negotiation.cc:407] Connection header received
0812 06:13:17.287522 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:17.287531 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:17.287601 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:17.287761 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:17.288410 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:17.289817 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:17.290668 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:17.291107 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:17.291238 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:17.293931 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:17.293936 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:17.293936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:17.293951 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:17.296426 (+ 2475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:17.296877 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:17.296880 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:17.296881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:17.296989 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:17.297221 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:17.297222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:17.297222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:17.297570 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:17.297726 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:17.298187 (+ 461us) server_negotiation.cc:299] Negotiation successful
0812 06:13:17.298349 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":85,"threads_started":1}
I20260812 06:13:17.299642 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:13:17.322616 5401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:17.316794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45118 (local address 127.0.176.254:44347)
0812 06:13:17.316845 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:17.316847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:17.316945 (+ 98us) server_negotiation.cc:407] Connection header received
0812 06:13:17.317001 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:17.317002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:17.317013 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:17.317095 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:17.317726 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:17.319038 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:17.320162 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:17.320527 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:17.320610 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:17.321595 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:17.321598 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:17.321598 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:17.322271 (+ 673us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:17.322303 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:17.322314 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:17.322396 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:17.322480 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 06:13:17.322518 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:13:17.339560 5412 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:17.340389 5412 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:17.351924 5412 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 507aa0d2b68e4e9ea1a2e7d1303e2c89: Generated new TSK 0
I20260812 06:13:17.352188 5412 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:13:17.355903 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 5290
2026-08-12T06:13:17Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1614 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:13:17 dist-test-slave-gw5c krb5kdc[5445](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:13:17 dist-test-slave-gw5c krb5kdc[5445](info): set up 2 sockets
Aug 12 06:13:17 dist-test-slave-gw5c krb5kdc[5445](info): commencing operation
krb5kdc: starting...
W20260812 06:13:18.643731 707 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:18 dist-test-slave-gw5c krb5kdc[5445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515198, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:13:18.776788 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:37851
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:37851
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:18.866833 5468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:18.867076 5468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:18.867101 5468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:18.868386 5468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:18.868438 5468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:18.868453 5468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:18.868465 5468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:18.868477 5468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:18.870020 5468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:37851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:37851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:18.870245 5468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:18.870455 5468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:18.875599 5480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:18.875684 5475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:18.875556 5476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:18.875937 5468 server_base.cc:1034] running on GCE node
I20260812 06:13:18.876200 5468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:18.876519 5468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:18.877718 5468 hybrid_clock.cc:648] HybridClock initialized: now 1786515198877675 us; error 56 us; skew 500 ppm
Aug 12 06:13:18 dist-test-slave-gw5c krb5kdc[5445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515198, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:18.880966 5468 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:13:18.881469 5468 webserver.cc:460] Webserver started at http://127.0.176.254:37127/ using document root <none> and password file <none>
I20260812 06:13:18.881737 5468 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:18.881786 5468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:18.881889 5468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:18.883066 5468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "2b3dae4a69b74783ab213736fa2230a9"
format_stamp: "Formatted at 2026-08-12 06:13:18 on dist-test-slave-gw5c"
server_key: "0f34fc04e8344c4e3bd5bfdf3259ff2b"
server_key_iv: "f8e59752ce460170ac691fd09a3d91ea"
server_key_version: "encryptionkey@0"
I20260812 06:13:18.883463 5468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "2b3dae4a69b74783ab213736fa2230a9"
format_stamp: "Formatted at 2026-08-12 06:13:18 on dist-test-slave-gw5c"
server_key: "0f34fc04e8344c4e3bd5bfdf3259ff2b"
server_key_iv: "f8e59752ce460170ac691fd09a3d91ea"
server_key_version: "encryptionkey@0"
I20260812 06:13:18.884948 5468 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:18.885830 5490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:18.886062 5468 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:13:18.886176 5468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "2b3dae4a69b74783ab213736fa2230a9"
format_stamp: "Formatted at 2026-08-12 06:13:18 on dist-test-slave-gw5c"
server_key: "0f34fc04e8344c4e3bd5bfdf3259ff2b"
server_key_iv: "f8e59752ce460170ac691fd09a3d91ea"
server_key_version: "encryptionkey@0"
I20260812 06:13:18.886256 5468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:18.913041 5468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:18.915333 5468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:18.915556 5468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:18.919930 5468 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:37851
I20260812 06:13:18.920007 5579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:37851 every 8 connection(s)
I20260812 06:13:18.920388 5468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:18.921528 5580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:18.923666 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 5468
I20260812 06:13:18.923758 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:18.923972 707 external_mini_cluster.cc:1428] Setting key 251ed62ec21e666411ff95f51873d501
I20260812 06:13:18.926280 5580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9: Bootstrap starting.
I20260812 06:13:18.926970 5580 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:18.927292 5580 log.cc:824] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:18.928160 5580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9: No bootstrap required, opened a new log
I20260812 06:13:18.930413 5580 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3dae4a69b74783ab213736fa2230a9" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37851 } }
I20260812 06:13:18.930594 5580 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:18.930635 5580 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3dae4a69b74783ab213736fa2230a9, State: Initialized, Role: FOLLOWER
I20260812 06:13:18.930823 5580 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3dae4a69b74783ab213736fa2230a9" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37851 } }
I20260812 06:13:18.930935 5580 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:18.930986 5580 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:18.931033 5580 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:18.931741 5580 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3dae4a69b74783ab213736fa2230a9" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37851 } }
I20260812 06:13:18.931849 5580 leader_election.cc:302] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b3dae4a69b74783ab213736fa2230a9; no voters:
I20260812 06:13:18.932117 5580 leader_election.cc:288] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:18.932154 5586 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:18.932313 5586 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2b3dae4a69b74783ab213736fa2230a9, State: Running, Role: LEADER
I20260812 06:13:18.932430 5580 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:18.932466 5586 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3dae4a69b74783ab213736fa2230a9" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37851 } }
Aug 12 06:13:18 dist-test-slave-gw5c krb5kdc[5445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515198, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:18.932880 5586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b3dae4a69b74783ab213736fa2230a9. Latest consensus state: current_term: 1 leader_uuid: "2b3dae4a69b74783ab213736fa2230a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3dae4a69b74783ab213736fa2230a9" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37851 } } }
I20260812 06:13:18.932976 5586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:18.933244 5596 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:18.933584 5587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b3dae4a69b74783ab213736fa2230a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b3dae4a69b74783ab213736fa2230a9" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37851 } } }
I20260812 06:13:18.933756 5587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:18.933987 5596 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:18.935940 5596 catalog_manager.cc:1347] Generated new cluster ID: d266a0e9e2154695b7d22d0373d75222
I20260812 06:13:18.935998 5596 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:18.938097 5584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:18.924597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47974 (local address 127.0.176.254:37851)
0812 06:13:18.924810 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:18.924821 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:18.924867 (+ 46us) server_negotiation.cc:407] Connection header received
0812 06:13:18.925442 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:18.925452 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:18.925521 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:18.925700 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:18.926659 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:18.927732 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:18.929427 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:18.930141 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:18.930264 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:18.933407 (+ 3143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:18.933412 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:18.933413 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:18.933427 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:18.935926 (+ 2499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:18.936406 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:18.936409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:18.936409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:18.936517 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:18.936730 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:18.936730 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:18.936731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:18.937050 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:18.937203 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:18.937702 (+ 499us) server_negotiation.cc:299] Negotiation successful
0812 06:13:18.937854 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":94,"threads_started":1}
I20260812 06:13:18.956187 5596 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:18.956789 5596 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:18.963048 5596 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b3dae4a69b74783ab213736fa2230a9: Generated new TSK 0
I20260812 06:13:18.963277 5596 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:13:18.995173 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37851
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:19.089845 5622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:19.090072 5622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:19.090101 5622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:19.091373 5622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:19.091482 5622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:19.091526 5622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:19.093142 5622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:19.093365 5622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:19.093560 5622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:19.099201 5631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:19.099210 5638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:19.099212 5632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:19.099478 5622 server_base.cc:1034] running on GCE node
I20260812 06:13:19.099732 5622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:19.100028 5622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:19.101212 5622 hybrid_clock.cc:648] HybridClock initialized: now 1786515199101196 us; error 44 us; skew 500 ppm
Aug 12 06:13:19 dist-test-slave-gw5c krb5kdc[5445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515199, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:19.104001 5622 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:13:19.104516 5622 webserver.cc:460] Webserver started at http://127.0.176.193:40879/ using document root <none> and password file <none>
I20260812 06:13:19.104763 5622 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:19.104810 5622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:19.104962 5622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:19.106204 5622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "a037776e24964b9bb36255fec28ae3ad"
format_stamp: "Formatted at 2026-08-12 06:13:19 on dist-test-slave-gw5c"
server_key: "8995495a040db630312f310882265bbb"
server_key_iv: "a48fd512e001a14e5e69d96de7597bef"
server_key_version: "encryptionkey@0"
I20260812 06:13:19.106618 5622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "a037776e24964b9bb36255fec28ae3ad"
format_stamp: "Formatted at 2026-08-12 06:13:19 on dist-test-slave-gw5c"
server_key: "8995495a040db630312f310882265bbb"
server_key_iv: "a48fd512e001a14e5e69d96de7597bef"
server_key_version: "encryptionkey@0"
I20260812 06:13:19.108163 5622 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:19.109030 5646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:19.109267 5622 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:19.109346 5622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "a037776e24964b9bb36255fec28ae3ad"
format_stamp: "Formatted at 2026-08-12 06:13:19 on dist-test-slave-gw5c"
server_key: "8995495a040db630312f310882265bbb"
server_key_iv: "a48fd512e001a14e5e69d96de7597bef"
server_key_version: "encryptionkey@0"
I20260812 06:13:19.109436 5622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:19.119606 5622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:19.123183 5622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:19.123353 5622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:19.123692 5622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:19.124058 5622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:19.124095 5622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:19.124120 5622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:19.124167 5622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:19.130708 5622 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:43895
I20260812 06:13:19.130754 5827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:43895 every 8 connection(s)
I20260812 06:13:19.131107 5622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:19.133431 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 5622
I20260812 06:13:19.133553 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:19.133775 707 external_mini_cluster.cc:1428] Setting key a3bf63702e279c1a1b051b22a80c7191
Aug 12 06:13:19 dist-test-slave-gw5c krb5kdc[5445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515199, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:19.143026 5584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:19.132095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:52813 (local address 127.0.176.254:37851)
0812 06:13:19.132191 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:19.132193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:19.132207 (+ 14us) server_negotiation.cc:407] Connection header received
0812 06:13:19.132906 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:19.132908 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:19.132923 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:19.133105 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:19.134329 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.135048 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.136140 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.136491 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.136581 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:19.139337 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:19.139339 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:19.139339 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:19.139349 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:19.141381 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:19.141943 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:19.141944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:19.141945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:19.142017 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:19.142278 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:19.142279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:19.142280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:19.142455 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:19.142531 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:19.142805 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 06:13:19.142910 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 06:13:19.143066 5834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:19.131902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:37851 (local address 127.0.176.193:52813)
0812 06:13:19.132089 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:19.132136 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:19.132796 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:19.133105 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:19.133108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:19.133945 (+ 837us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:19.134230 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:19.134236 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.135154 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.135155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:19.136047 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:19.136050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.136608 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.136609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:19.136773 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:19.137362 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:19.137372 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:19.139227 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:19.141486 (+ 2259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:19.141494 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:19.141496 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:19.141851 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:19.142095 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:19.142096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:19.142096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:19.142207 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:19.142525 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:19.142530 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:19.142665 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 06:13:19.142751 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 06:13:19.142893 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":103,"threads_started":1}
I20260812 06:13:19.143704 5828 heartbeater.cc:347] Connected to a master server at 127.0.176.254:37851
I20260812 06:13:19.143822 5828 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:19.144055 5828 heartbeater.cc:511] Master 127.0.176.254:37851 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
I20260812 06:13:19.144672 5517 ts_manager.cc:194] Registered new tserver with Master: a037776e24964b9bb36255fec28ae3ad (127.0.176.193:43895)
I20260812 06:13:19.145303 5517 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:52813
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:13:19.164172 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37851
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:19.251865 5838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:19.252140 5838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:19.252194 5838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:19.253422 5838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:19.253504 5838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:19.253553 5838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:19.255152 5838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:19.255542 5838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:19.255826 5838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:19.261251 5850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:19.261303 5849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:19.261435 5838 server_base.cc:1034] running on GCE node
W20260812 06:13:19.261255 5852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:19.261766 5838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:19.262028 5838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:19.263175 5838 hybrid_clock.cc:648] HybridClock initialized: now 1786515199263158 us; error 34 us; skew 500 ppm
Aug 12 06:13:19 dist-test-slave-gw5c krb5kdc[5445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515199, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:19.266007 5838 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:13:19.266543 5838 webserver.cc:460] Webserver started at http://127.0.176.194:33057/ using document root <none> and password file <none>
I20260812 06:13:19.266810 5838 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:19.266884 5838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:19.267043 5838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:19.268258 5838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "7584a737d3cc4939b2206b77ac4f4f5f"
format_stamp: "Formatted at 2026-08-12 06:13:19 on dist-test-slave-gw5c"
server_key: "d342ab431aeafb0d85453b6488fb2fe1"
server_key_iv: "1669681c4b88881389e1c669b6585462"
server_key_version: "encryptionkey@0"
I20260812 06:13:19.268653 5838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "7584a737d3cc4939b2206b77ac4f4f5f"
format_stamp: "Formatted at 2026-08-12 06:13:19 on dist-test-slave-gw5c"
server_key: "d342ab431aeafb0d85453b6488fb2fe1"
server_key_iv: "1669681c4b88881389e1c669b6585462"
server_key_version: "encryptionkey@0"
I20260812 06:13:19.270193 5838 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:19.271310 5863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:19.271741 5838 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:19.271881 5838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "7584a737d3cc4939b2206b77ac4f4f5f"
format_stamp: "Formatted at 2026-08-12 06:13:19 on dist-test-slave-gw5c"
server_key: "d342ab431aeafb0d85453b6488fb2fe1"
server_key_iv: "1669681c4b88881389e1c669b6585462"
server_key_version: "encryptionkey@0"
I20260812 06:13:19.271983 5838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:19.294714 5838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:19.297169 5838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:19.297379 5838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:19.297657 5838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:19.298010 5838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:19.298074 5838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:19.298117 5838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:19.298164 5838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:19.304684 5838 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:46337
I20260812 06:13:19.304744 6058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:46337 every 8 connection(s)
I20260812 06:13:19.305117 5838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:13:19.311354 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 5838
I20260812 06:13:19.311530 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:13:19.311816 707 external_mini_cluster.cc:1428] Setting key f968816930c0d127af6f114ea2d105cb
Aug 12 06:13:19 dist-test-slave-gw5c krb5kdc[5445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515199, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:19.317469 5584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:19.305980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:47357 (local address 127.0.176.254:37851)
0812 06:13:19.306031 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:19.306033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:19.306303 (+ 270us) server_negotiation.cc:407] Connection header received
0812 06:13:19.306790 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:19.306791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:19.306803 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:19.306873 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:19.307958 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.308557 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.309707 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.309932 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.309997 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:19.312955 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:19.312959 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:19.312959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:19.312973 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:19.315573 (+ 2600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:19.316273 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:19.316274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:19.316274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:19.316345 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:19.316680 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:19.316681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:19.316681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:19.316854 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:19.316933 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:19.317208 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 06:13:19.317315 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:13:19.317497 6070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:19.305935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:37851 (local address 127.0.176.194:47357)
0812 06:13:19.306129 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:19.306177 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:19.306691 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:19.306963 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:19.306967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:19.307645 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:19.307856 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:19.307861 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.308692 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.308693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:19.309565 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:19.309568 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.310027 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.310028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:19.310143 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:19.310877 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:19.310887 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:19.312767 (+ 1880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:19.315721 (+ 2954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:19.315736 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:19.315740 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:19.316170 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:19.316428 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:19.316429 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:19.316429 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:19.316598 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:19.316927 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:19.316933 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:19.317071 (+ 138us) client_negotiation.cc:769] Sending connection context
0812 06:13:19.317165 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 06:13:19.317312 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":96,"threads_started":1}
I20260812 06:13:19.318092 6059 heartbeater.cc:347] Connected to a master server at 127.0.176.254:37851
I20260812 06:13:19.318226 6059 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:19.318432 6059 heartbeater.cc:511] Master 127.0.176.254:37851 requested a full tablet report, sending...
I20260812 06:13:19.318898 5517 ts_manager.cc:194] Registered new tserver with Master: 7584a737d3cc4939b2206b77ac4f4f5f (127.0.176.194:46337)
I20260812 06:13:19.319317 5517 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:47357
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:13:19.342645 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37851
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:19.442390 6076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:19.442651 6076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:19.442678 6076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:19.444244 6076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:19.444411 6076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:19.444506 6076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:19.446396 6076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:19.446669 6076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:19.446954 6076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:19.452296 6082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:19.452310 6084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:19.452306 6087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:19.452786 6076 server_base.cc:1034] running on GCE node
I20260812 06:13:19.453262 6076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:19.453572 6076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:19.454788 6076 hybrid_clock.cc:648] HybridClock initialized: now 1786515199454775 us; error 33 us; skew 500 ppm
Aug 12 06:13:19 dist-test-slave-gw5c krb5kdc[5445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515199, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:19.457782 6076 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:13:19.458248 6076 webserver.cc:460] Webserver started at http://127.0.176.195:39951/ using document root <none> and password file <none>
I20260812 06:13:19.458499 6076 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:19.458550 6076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:19.458696 6076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:19.459920 6076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "53e11cbf30f3435eb69ecf70772f8fc0"
format_stamp: "Formatted at 2026-08-12 06:13:19 on dist-test-slave-gw5c"
server_key: "7b0344b0ed0e3c6f15090c4857ef710c"
server_key_iv: "ba90f6a7560b7ac7e6e5e46b9b9ae5a9"
server_key_version: "encryptionkey@0"
I20260812 06:13:19.460296 6076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "53e11cbf30f3435eb69ecf70772f8fc0"
format_stamp: "Formatted at 2026-08-12 06:13:19 on dist-test-slave-gw5c"
server_key: "7b0344b0ed0e3c6f15090c4857ef710c"
server_key_iv: "ba90f6a7560b7ac7e6e5e46b9b9ae5a9"
server_key_version: "encryptionkey@0"
I20260812 06:13:19.461877 6076 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:13:19.462831 6097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:19.463052 6076 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:19.463164 6076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "53e11cbf30f3435eb69ecf70772f8fc0"
format_stamp: "Formatted at 2026-08-12 06:13:19 on dist-test-slave-gw5c"
server_key: "7b0344b0ed0e3c6f15090c4857ef710c"
server_key_iv: "ba90f6a7560b7ac7e6e5e46b9b9ae5a9"
server_key_version: "encryptionkey@0"
I20260812 06:13:19.463248 6076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:19.478566 6076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:19.481797 6076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:19.481947 6076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:19.482415 6076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:19.482793 6076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:19.482831 6076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:19.482858 6076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:19.482872 6076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:19.489254 6076 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:39869
I20260812 06:13:19.489326 6285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:39869 every 8 connection(s)
I20260812 06:13:19.489696 6076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:13:19.491598 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 6076
I20260812 06:13:19.491686 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:13:19.491881 707 external_mini_cluster.cc:1428] Setting key 51296e9ac72416453f2326627dc55b26
Aug 12 06:13:19 dist-test-slave-gw5c krb5kdc[5445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515199, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:19.499854 5584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:19.490506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:38837 (local address 127.0.176.254:37851)
0812 06:13:19.490567 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:19.490569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:19.490787 (+ 218us) server_negotiation.cc:407] Connection header received
0812 06:13:19.491362 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:19.491363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:19.491376 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:19.491451 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:19.492750 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.493272 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.494303 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.494519 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.494611 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:19.496987 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:19.496989 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:19.496989 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:19.496997 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:19.498312 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:19.498820 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:19.498822 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:19.498822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:19.498887 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:19.499149 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:19.499150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:19.499151 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:19.499283 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:19.499364 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:19.499664 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 06:13:19.499749 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:13:19.500077 6290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:19.490486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:37851 (local address 127.0.176.195:38837)
0812 06:13:19.490662 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:19.490699 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:19.491231 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:19.491542 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:19.491546 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:19.492336 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:19.492603 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:19.492610 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.493386 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.493387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:19.494207 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:19.494210 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.494625 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.494626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:19.494761 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:19.495354 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:19.495363 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:19.496882 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:19.498490 (+ 1608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:19.498498 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:19.498500 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:19.498731 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:19.498958 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:19.498972 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:19.498972 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:19.499082 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:19.499355 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:19.499362 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:19.499530 (+ 168us) client_negotiation.cc:769] Sending connection context
0812 06:13:19.499643 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 06:13:19.499825 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":93,"threads_started":1}
I20260812 06:13:19.500605 6287 heartbeater.cc:347] Connected to a master server at 127.0.176.254:37851
I20260812 06:13:19.500710 6287 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:19.500911 6287 heartbeater.cc:511] Master 127.0.176.254:37851 requested a full tablet report, sending...
I20260812 06:13:19.501375 5517 ts_manager.cc:194] Registered new tserver with Master: 53e11cbf30f3435eb69ecf70772f8fc0 (127.0.176.195:39869)
I20260812 06:13:19.501748 5517 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:38837
I20260812 06:13:19.503829 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:13:19 dist-test-slave-gw5c krb5kdc[5445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515199, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 06:13:19 dist-test-slave-gw5c krb5kdc[5445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515199, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:19.530944 5584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:19.522825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47978 (local address 127.0.176.254:37851)
0812 06:13:19.522902 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:19.522904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:19.523041 (+ 137us) server_negotiation.cc:407] Connection header received
0812 06:13:19.523096 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:19.523097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:19.523106 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:19.523160 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:19.523920 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.524434 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.525342 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:19.525539 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:19.525606 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:19.528368 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:19.528370 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:19.528370 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:19.528378 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:19.529688 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:19.530109 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:19.530110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:19.530110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:19.530165 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:19.530380 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:19.530380 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:19.530381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:19.530542 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:19.530620 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:19.530760 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 06:13:19.530834 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260812 06:13:19.531270 5517 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:47978
I20260812 06:13:19.531987 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 5622
I20260812 06:13:19.544870 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 5838
I20260812 06:13:19.586884 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 6076
I20260812 06:13:19.603492 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 5468
2026-08-12T06:13:19Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2258 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:13:19 dist-test-slave-gw5c krb5kdc[6309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:13:19 dist-test-slave-gw5c krb5kdc[6309](info): set up 2 sockets
Aug 12 06:13:19 dist-test-slave-gw5c krb5kdc[6309](info): commencing operation
krb5kdc: starting...
W20260812 06:13:20.921397 707 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[6309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:13:21.056565 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:36689
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:36689
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:21.151000 6327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:21.151254 6327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:21.151281 6327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:21.152805 6327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:21.152875 6327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:21.152890 6327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:21.152905 6327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:21.152918 6327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:21.154673 6327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:36689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:36689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:21.155005 6327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:21.155275 6327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:21.160694 6337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:21.160745 6344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:21.160704 6338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:21.160982 6327 server_base.cc:1034] running on GCE node
I20260812 06:13:21.161242 6327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:21.161564 6327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:21.162745 6327 hybrid_clock.cc:648] HybridClock initialized: now 1786515201162724 us; error 38 us; skew 500 ppm
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[6309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515201, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:21.165963 6327 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:13:21.166545 6327 webserver.cc:460] Webserver started at http://127.0.176.254:38689/ using document root <none> and password file <none>
I20260812 06:13:21.166797 6327 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:21.166852 6327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:21.166991 6327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:21.168354 6327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "c2618f492cba4090a7a8490e549dd8b4"
format_stamp: "Formatted at 2026-08-12 06:13:21 on dist-test-slave-gw5c"
server_key: "1de317aa8f9f52be2ad8e107979d12a5"
server_key_iv: "61f8827d99c2adb6d516abd5b9380b7b"
server_key_version: "encryptionkey@0"
I20260812 06:13:21.168779 6327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "c2618f492cba4090a7a8490e549dd8b4"
format_stamp: "Formatted at 2026-08-12 06:13:21 on dist-test-slave-gw5c"
server_key: "1de317aa8f9f52be2ad8e107979d12a5"
server_key_iv: "61f8827d99c2adb6d516abd5b9380b7b"
server_key_version: "encryptionkey@0"
I20260812 06:13:21.170406 6327 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:21.171540 6356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:21.171893 6327 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:21.172039 6327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "c2618f492cba4090a7a8490e549dd8b4"
format_stamp: "Formatted at 2026-08-12 06:13:21 on dist-test-slave-gw5c"
server_key: "1de317aa8f9f52be2ad8e107979d12a5"
server_key_iv: "61f8827d99c2adb6d516abd5b9380b7b"
server_key_version: "encryptionkey@0"
I20260812 06:13:21.172142 6327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:21.189152 6327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:21.191778 6327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:21.191987 6327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:21.196630 6327 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:36689
I20260812 06:13:21.197109 6327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:21.197448 6447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:36689 every 8 connection(s)
I20260812 06:13:21.198308 6448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:21.201690 6448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4: Bootstrap starting.
I20260812 06:13:21.202484 6448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:21.203140 6448 log.cc:824] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:21.203383 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 6327
I20260812 06:13:21.203575 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:21.203783 707 external_mini_cluster.cc:1428] Setting key 37c93d80a5b5789400f2cb2dbdb7388f
I20260812 06:13:21.204407 6448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4: No bootstrap required, opened a new log
I20260812 06:13:21.206632 6448 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2618f492cba4090a7a8490e549dd8b4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36689 } }
I20260812 06:13:21.206822 6448 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:21.206847 6448 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2618f492cba4090a7a8490e549dd8b4, State: Initialized, Role: FOLLOWER
I20260812 06:13:21.207010 6448 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2618f492cba4090a7a8490e549dd8b4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36689 } }
I20260812 06:13:21.207141 6448 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:21.207221 6448 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:21.207279 6448 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:21.208509 6448 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2618f492cba4090a7a8490e549dd8b4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36689 } }
I20260812 06:13:21.208652 6448 leader_election.cc:302] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2618f492cba4090a7a8490e549dd8b4; no voters:
I20260812 06:13:21.208859 6448 leader_election.cc:288] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:21.208906 6453 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:21.209162 6453 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [term 1 LEADER]: Becoming Leader. State: Replica: c2618f492cba4090a7a8490e549dd8b4, State: Running, Role: LEADER
I20260812 06:13:21.209353 6448 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:21.209328 6453 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2618f492cba4090a7a8490e549dd8b4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36689 } }
I20260812 06:13:21.209867 6455 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2618f492cba4090a7a8490e549dd8b4. Latest consensus state: current_term: 1 leader_uuid: "c2618f492cba4090a7a8490e549dd8b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2618f492cba4090a7a8490e549dd8b4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36689 } } }
I20260812 06:13:21.209965 6455 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:21.210206 6454 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2618f492cba4090a7a8490e549dd8b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2618f492cba4090a7a8490e549dd8b4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36689 } } }
I20260812 06:13:21.210551 6454 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4 [sys.catalog]: This master's current role is: LEADER
W20260812 06:13:21.211341 6485 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:13:21.211515 6485 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:13:21.211580 6462 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:21.211762 6462 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[6309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:21.213896 6462 catalog_manager.cc:1347] Generated new cluster ID: bbe47d282ad342f39254df59f18b8b2e
I20260812 06:13:21.213954 6462 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:21.218051 6452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:21.204440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59636 (local address 127.0.176.254:36689)
0812 06:13:21.204702 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:21.204711 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:21.204741 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:13:21.206691 (+ 1950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:21.206701 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:21.206770 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:21.206981 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:21.207865 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.208807 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.209886 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.210470 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.210582 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:21.213890 (+ 3308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:21.213895 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:21.213907 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:21.213922 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:21.216141 (+ 2219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:21.216704 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:21.216712 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:21.216713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:21.216852 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:21.217108 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:21.217109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:21.217109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:21.217385 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:21.217597 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:21.217671 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 06:13:21.217842 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":142,"threads_started":1}
I20260812 06:13:21.223991 6462 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:21.224792 6462 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:21.231029 6462 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2618f492cba4090a7a8490e549dd8b4: Generated new TSK 0
I20260812 06:13:21.231288 6462 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:13:21.264599 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36689
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:21.356819 6493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:21.357128 6493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:21.357162 6493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:21.358496 6493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:21.358554 6493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:21.358587 6493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:21.360400 6493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:21.360857 6493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:21.361176 6493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:21.366953 6501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:21.366953 6502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:21.366954 6504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:21.367067 6493 server_base.cc:1034] running on GCE node
I20260812 06:13:21.367476 6493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:21.367805 6493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:21.368999 6493 hybrid_clock.cc:648] HybridClock initialized: now 1786515201368976 us; error 68 us; skew 500 ppm
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[6309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515201, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:21.372537 6493 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:13:21.373554 6493 webserver.cc:460] Webserver started at http://127.0.176.193:45817/ using document root <none> and password file <none>
I20260812 06:13:21.373853 6493 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:21.373903 6493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:21.374073 6493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:21.375350 6493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "cd59e24303f042aea3d72de4576f78b4"
format_stamp: "Formatted at 2026-08-12 06:13:21 on dist-test-slave-gw5c"
server_key: "1663e3fe019291e496d9e2a008ae5783"
server_key_iv: "71d2ed1fa24483915071e16993ff1a29"
server_key_version: "encryptionkey@0"
I20260812 06:13:21.375891 6493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "cd59e24303f042aea3d72de4576f78b4"
format_stamp: "Formatted at 2026-08-12 06:13:21 on dist-test-slave-gw5c"
server_key: "1663e3fe019291e496d9e2a008ae5783"
server_key_iv: "71d2ed1fa24483915071e16993ff1a29"
server_key_version: "encryptionkey@0"
I20260812 06:13:21.377895 6493 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260812 06:13:21.379371 6514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:21.379669 6493 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:21.379781 6493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "cd59e24303f042aea3d72de4576f78b4"
format_stamp: "Formatted at 2026-08-12 06:13:21 on dist-test-slave-gw5c"
server_key: "1663e3fe019291e496d9e2a008ae5783"
server_key_iv: "71d2ed1fa24483915071e16993ff1a29"
server_key_version: "encryptionkey@0"
I20260812 06:13:21.379899 6493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:21.396499 6493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:21.399302 6493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:21.399577 6493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:21.399925 6493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:21.400292 6493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:21.400329 6493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:21.400378 6493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:21.400405 6493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:21.407191 6493 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:40497
I20260812 06:13:21.407238 6713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:40497 every 8 connection(s)
I20260812 06:13:21.407675 6493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:21.411823 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 6493
I20260812 06:13:21.411952 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:21.412194 707 external_mini_cluster.cc:1428] Setting key 3c49c9d42bb8bbcebcf3c88a22847da9
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[6309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515201, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:21.419885 6452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:21.408573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:40039 (local address 127.0.176.254:36689)
0812 06:13:21.408651 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:21.408654 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:21.408898 (+ 244us) server_negotiation.cc:407] Connection header received
0812 06:13:21.410174 (+ 1276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:21.410175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:21.410201 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:21.410260 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:21.411146 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.411753 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.413131 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.413353 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.413437 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:21.416373 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:21.416375 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:21.416376 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:21.416390 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:21.418101 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:21.418644 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:21.418645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:21.418646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:21.418718 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:21.419021 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:21.419022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:21.419023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:21.419165 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:21.419244 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:21.419658 (+ 414us) server_negotiation.cc:299] Negotiation successful
0812 06:13:21.419775 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 06:13:21.420089 6717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:21.408557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36689 (local address 127.0.176.193:40039)
0812 06:13:21.408762 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:21.408802 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:21.409993 (+ 1191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:21.410401 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:21.410404 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:21.410789 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:21.411010 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:21.411014 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.411886 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.411887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:21.413031 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:21.413034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.413448 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.413450 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:21.413596 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:21.414241 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:21.414251 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:21.416246 (+ 1995us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:21.418238 (+ 1992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:21.418250 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:21.418253 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:21.418550 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:21.418804 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:21.418805 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:21.418805 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:21.418933 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:21.419246 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:21.419254 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:21.419493 (+ 239us) client_negotiation.cc:769] Sending connection context
0812 06:13:21.419636 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 06:13:21.419823 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":111,"threads_started":1}
I20260812 06:13:21.420619 6714 heartbeater.cc:347] Connected to a master server at 127.0.176.254:36689
I20260812 06:13:21.420751 6714 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:21.421003 6714 heartbeater.cc:511] Master 127.0.176.254:36689 requested a full tablet report, sending...
I20260812 06:13:21.421698 6383 ts_manager.cc:194] Registered new tserver with Master: cd59e24303f042aea3d72de4576f78b4 (127.0.176.193:40497)
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
I20260812 06:13:21.422547 6383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:40039
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:13:21.442401 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36689
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:21.535643 6723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:21.535887 6723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:21.535915 6723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:21.537209 6723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:21.537266 6723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:21.537303 6723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:21.539011 6723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:21.539300 6723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:21.539597 6723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:21.545253 6729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:21.545248 6738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:21.545249 6734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:21.545567 6723 server_base.cc:1034] running on GCE node
I20260812 06:13:21.545826 6723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:21.546111 6723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:21.547289 6723 hybrid_clock.cc:648] HybridClock initialized: now 1786515201547268 us; error 34 us; skew 500 ppm
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[6309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515201, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:21.550251 6723 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:13:21.550787 6723 webserver.cc:460] Webserver started at http://127.0.176.194:46681/ using document root <none> and password file <none>
I20260812 06:13:21.551079 6723 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:21.551158 6723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:21.551327 6723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:21.552641 6723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "06a9fcc956ad4bf7a9840cba7be94d24"
format_stamp: "Formatted at 2026-08-12 06:13:21 on dist-test-slave-gw5c"
server_key: "2c53fb8e515114a175defcabf79eba5a"
server_key_iv: "ca7abec801682040c19c1a6fc264c342"
server_key_version: "encryptionkey@0"
I20260812 06:13:21.553072 6723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "06a9fcc956ad4bf7a9840cba7be94d24"
format_stamp: "Formatted at 2026-08-12 06:13:21 on dist-test-slave-gw5c"
server_key: "2c53fb8e515114a175defcabf79eba5a"
server_key_iv: "ca7abec801682040c19c1a6fc264c342"
server_key_version: "encryptionkey@0"
I20260812 06:13:21.554845 6723 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 06:13:21.555883 6746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:21.556079 6723 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:13:21.556205 6723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "06a9fcc956ad4bf7a9840cba7be94d24"
format_stamp: "Formatted at 2026-08-12 06:13:21 on dist-test-slave-gw5c"
server_key: "2c53fb8e515114a175defcabf79eba5a"
server_key_iv: "ca7abec801682040c19c1a6fc264c342"
server_key_version: "encryptionkey@0"
I20260812 06:13:21.556306 6723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:21.591101 6723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:21.594272 6723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:21.594509 6723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:21.594820 6723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:21.595191 6723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:21.595551 6723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:21.595649 6723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:21.595677 6723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:21.601994 6723 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:35959
I20260812 06:13:21.602042 6968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:35959 every 8 connection(s)
I20260812 06:13:21.602491 6723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[6309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515201, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:21.610464 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 6723
I20260812 06:13:21.610594 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:13:21.610812 707 external_mini_cluster.cc:1428] Setting key 0679d1a47b7b3e8b5ff4d681ddb49070
I20260812 06:13:21.613246 6452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:21.603318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:51385 (local address 127.0.176.254:36689)
0812 06:13:21.603420 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:21.603422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:21.603660 (+ 238us) server_negotiation.cc:407] Connection header received
0812 06:13:21.604820 (+ 1160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:21.604822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:21.604834 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:21.604898 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:21.605551 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.606058 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.607080 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.607289 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.607345 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:21.609887 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:21.609889 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:21.609890 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:21.609898 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:21.611650 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:21.612093 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:21.612094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:21.612095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:21.612158 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:21.612423 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:21.612424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:21.612425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:21.612546 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:21.612740 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:21.613055 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 06:13:21.613151 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:13:21.613487 6974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:21.603295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36689 (local address 127.0.176.194:51385)
0812 06:13:21.603523 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:21.603564 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:21.604664 (+ 1100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:21.604963 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:21.604967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:21.605244 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:21.605451 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:21.605455 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.606149 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.606149 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:21.606990 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:21.606992 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.607372 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.607373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:21.607565 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:21.608076 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:21.608085 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:21.609780 (+ 1695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:21.611738 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:21.611747 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:21.611750 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:21.612008 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:21.612235 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:21.612235 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:21.612236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:21.612354 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:21.612727 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:21.612735 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:21.612904 (+ 169us) client_negotiation.cc:769] Sending connection context
0812 06:13:21.613030 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 06:13:21.613223 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":134,"threads_started":1}
I20260812 06:13:21.613997 6969 heartbeater.cc:347] Connected to a master server at 127.0.176.254:36689
I20260812 06:13:21.614115 6969 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:21.614328 6969 heartbeater.cc:511] Master 127.0.176.254:36689 requested a full tablet report, sending...
I20260812 06:13:21.614842 6383 ts_manager.cc:194] Registered new tserver with Master: 06a9fcc956ad4bf7a9840cba7be94d24 (127.0.176.194:35959)
I20260812 06:13:21.615250 6383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:51385
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:13:21.638644 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36689
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:21.732306 6979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:21.732571 6979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:21.732728 6979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:21.734035 6979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:21.734108 6979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:21.734164 6979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:21.735867 6979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:21.736147 6979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:21.736394 6979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:21.741811 6996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:21.741820 6992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:21.741820 6994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:21.742090 6979 server_base.cc:1034] running on GCE node
I20260812 06:13:21.742285 6979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:21.742671 6979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:21.743839 6979 hybrid_clock.cc:648] HybridClock initialized: now 1786515201743809 us; error 69 us; skew 500 ppm
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[6309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515201, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:21.746590 6979 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:13:21.747128 6979 webserver.cc:460] Webserver started at http://127.0.176.195:39421/ using document root <none> and password file <none>
I20260812 06:13:21.747440 6979 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:21.747501 6979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:21.747659 6979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:21.748819 6979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "6d740b9a53bd4cd0b86cfdbde28bcb28"
format_stamp: "Formatted at 2026-08-12 06:13:21 on dist-test-slave-gw5c"
server_key: "accbf81fde2ecfd8e8f6cb4633e10276"
server_key_iv: "6b08404945b94118f4692957c91153ed"
server_key_version: "encryptionkey@0"
I20260812 06:13:21.749298 6979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "6d740b9a53bd4cd0b86cfdbde28bcb28"
format_stamp: "Formatted at 2026-08-12 06:13:21 on dist-test-slave-gw5c"
server_key: "accbf81fde2ecfd8e8f6cb4633e10276"
server_key_iv: "6b08404945b94118f4692957c91153ed"
server_key_version: "encryptionkey@0"
I20260812 06:13:21.751152 6979 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 06:13:21.752183 7006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:21.752398 6979 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:21.752516 6979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "6d740b9a53bd4cd0b86cfdbde28bcb28"
format_stamp: "Formatted at 2026-08-12 06:13:21 on dist-test-slave-gw5c"
server_key: "accbf81fde2ecfd8e8f6cb4633e10276"
server_key_iv: "6b08404945b94118f4692957c91153ed"
server_key_version: "encryptionkey@0"
I20260812 06:13:21.752631 6979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:21.765431 6979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:21.768537 6979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:21.768769 6979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:21.769065 6979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:21.769511 6979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:21.769569 6979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:21.769606 6979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:21.769640 6979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:21.777351 6979 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:39295
I20260812 06:13:21.777391 7192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:39295 every 8 connection(s)
I20260812 06:13:21.777796 6979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[6309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515201, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:21.786554 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 6979
I20260812 06:13:21.786736 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:13:21.786986 707 external_mini_cluster.cc:1428] Setting key 86e1d235f404e5f2c2dce16c19cb285c
I20260812 06:13:21.789142 6452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:21.778697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:38197 (local address 127.0.176.254:36689)
0812 06:13:21.778769 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:21.778772 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:21.779024 (+ 252us) server_negotiation.cc:407] Connection header received
0812 06:13:21.780144 (+ 1120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:21.780145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:21.780162 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:21.780219 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:21.780943 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.781457 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.782520 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.782806 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.782891 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:21.785657 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:21.785659 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:21.785660 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:21.785670 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:21.787533 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:21.788038 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:21.788040 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:21.788040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:21.788111 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:21.788384 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:21.788385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:21.788386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:21.788523 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:21.788609 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:21.788936 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 06:13:21.789045 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 06:13:21.789389 7195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:21.778661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36689 (local address 127.0.176.195:38197)
0812 06:13:21.778871 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:21.778911 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:21.780016 (+ 1105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:21.780308 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:21.780312 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:21.780619 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:21.780830 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:21.780833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.781574 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.781575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:21.782402 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:21.782405 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.782902 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.782903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:21.783041 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:21.783737 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:21.783747 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:21.785520 (+ 1773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:21.787630 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:21.787643 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:21.787647 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:21.787937 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:21.788187 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:21.788190 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:21.788191 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:21.788309 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:21.788599 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:21.788607 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:21.788762 (+ 155us) client_negotiation.cc:769] Sending connection context
0812 06:13:21.788903 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 06:13:21.789097 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":95,"threads_started":1}
I20260812 06:13:21.790011 7193 heartbeater.cc:347] Connected to a master server at 127.0.176.254:36689
I20260812 06:13:21.790117 7193 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:21.790294 7193 heartbeater.cc:511] Master 127.0.176.254:36689 requested a full tablet report, sending...
I20260812 06:13:21.790715 6383 ts_manager.cc:194] Registered new tserver with Master: 6d740b9a53bd4cd0b86cfdbde28bcb28 (127.0.176.195:39295)
I20260812 06:13:21.791143 6383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:38197
I20260812 06:13:21.799134 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[6309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[6309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.193@KRBTEST.COM
I20260812 06:13:21.829005 7204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:21.819356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58942 (local address 127.0.176.193:40497)
0812 06:13:21.819597 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:21.819610 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:21.819621 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:21.819649 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:21.819651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:21.819667 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:21.819768 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:21.820451 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.821211 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.822010 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.822364 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.822456 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:21.825114 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:21.825128 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:21.825128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:21.825137 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:21.826903 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:21.827350 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:21.827354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:21.827355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:21.827474 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:21.827957 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:21.827960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:21.827960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:21.828265 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:21.828605 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:21.828719 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 06:13:21.828855 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":134,"threads_started":1}
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[6309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:21.838096 6452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:21.830840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59652 (local address 127.0.176.254:36689)
0812 06:13:21.830921 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:21.830924 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:21.830933 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:21.830959 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:21.830963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:21.830979 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:21.831053 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:21.831710 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.832230 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.832935 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:21.833135 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:21.833224 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:21.835675 (+ 2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:21.835677 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:21.835678 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:21.835686 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:21.836987 (+ 1301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:21.837349 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:21.837350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:21.837350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:21.837414 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:21.837599 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:21.837600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:21.837600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:21.837779 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:21.837866 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:21.837957 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 06:13:21.838027 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260812 06:13:21.838389 6383 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59652
I20260812 06:13:21.838800 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 6493
I20260812 06:13:21.850422 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 6723
I20260812 06:13:21.873327 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 6979
I20260812 06:13:21.887979 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 6327
2026-08-12T06:13:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2280 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[7215](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[7215](info): set up 2 sockets
Aug 12 06:13:21 dist-test-slave-gw5c krb5kdc[7215](info): commencing operation
krb5kdc: starting...
W20260812 06:13:23.188190 707 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:23 dist-test-slave-gw5c krb5kdc[7215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515203, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:13:23.326792 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:45445
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:43759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:45445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:23.418869 7235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:23.419189 7235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:23.419234 7235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:23.420958 7235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:23.421077 7235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:23.421108 7235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:23.421142 7235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:23.421167 7235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:23.423040 7235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:43759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:45445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:45445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:23.423362 7235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:23.423691 7235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:23.429664 7256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:23.429764 7254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:23.429728 7245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:23.430075 7235 server_base.cc:1034] running on GCE node
I20260812 06:13:23.430342 7235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:23.430641 7235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:23.431795 7235 hybrid_clock.cc:648] HybridClock initialized: now 1786515203431776 us; error 51 us; skew 500 ppm
Aug 12 06:13:23 dist-test-slave-gw5c krb5kdc[7215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515203, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:23.439486 7235 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:13:23.440006 7235 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:23.440091 7235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:23.440265 7235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:23.441457 7235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "41640de2952847f1bdd2a8ef130cd32f"
format_stamp: "Formatted at 2026-08-12 06:13:23 on dist-test-slave-gw5c"
server_key: "c98220c86eecca46240b7c8b5c09b68a"
server_key_iv: "df248c34f2de800fa6b1d441f3360206"
server_key_version: "encryptionkey@0"
I20260812 06:13:23.441861 7235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "41640de2952847f1bdd2a8ef130cd32f"
format_stamp: "Formatted at 2026-08-12 06:13:23 on dist-test-slave-gw5c"
server_key: "c98220c86eecca46240b7c8b5c09b68a"
server_key_iv: "df248c34f2de800fa6b1d441f3360206"
server_key_version: "encryptionkey@0"
I20260812 06:13:23.443706 7235 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 06:13:23.444738 7265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:23.444959 7235 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:23.445079 7235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "41640de2952847f1bdd2a8ef130cd32f"
format_stamp: "Formatted at 2026-08-12 06:13:23 on dist-test-slave-gw5c"
server_key: "c98220c86eecca46240b7c8b5c09b68a"
server_key_iv: "df248c34f2de800fa6b1d441f3360206"
server_key_version: "encryptionkey@0"
I20260812 06:13:23.445179 7235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:23.463811 7235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:23.466217 7235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:23.466427 7235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:23.471702 7235 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:45445
I20260812 06:13:23.471726 7353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:45445 every 8 connection(s)
I20260812 06:13:23.472074 7235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:23.473153 7355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:23.473419 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 7235
I20260812 06:13:23.473539 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:23.473750 707 external_mini_cluster.cc:1428] Setting key e3a80ae244c6e06c0e2156a176239ca0
I20260812 06:13:23.476642 7355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f: Bootstrap starting.
I20260812 06:13:23.477352 7355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:23.477675 7355 log.cc:824] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:23.478600 7355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f: No bootstrap required, opened a new log
I20260812 06:13:23.480839 7355 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41640de2952847f1bdd2a8ef130cd32f" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 45445 } }
I20260812 06:13:23.481032 7355 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:23.481102 7355 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41640de2952847f1bdd2a8ef130cd32f, State: Initialized, Role: FOLLOWER
I20260812 06:13:23.481283 7355 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41640de2952847f1bdd2a8ef130cd32f" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 45445 } }
I20260812 06:13:23.481387 7355 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:23.481434 7355 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:23.481494 7355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [term 0 FOLLOWER]: Advancing to term 1
Aug 12 06:13:23 dist-test-slave-gw5c krb5kdc[7215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515203, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:23.482218 7355 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41640de2952847f1bdd2a8ef130cd32f" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 45445 } }
I20260812 06:13:23.482344 7355 leader_election.cc:302] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41640de2952847f1bdd2a8ef130cd32f; no voters:
I20260812 06:13:23.482553 7355 leader_election.cc:288] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:23.482797 7365 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:23.482875 7355 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:23.482973 7365 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [term 1 LEADER]: Becoming Leader. State: Replica: 41640de2952847f1bdd2a8ef130cd32f, State: Running, Role: LEADER
I20260812 06:13:23.483068 7365 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41640de2952847f1bdd2a8ef130cd32f" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 45445 } }
I20260812 06:13:23.483603 7366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41640de2952847f1bdd2a8ef130cd32f. Latest consensus state: current_term: 1 leader_uuid: "41640de2952847f1bdd2a8ef130cd32f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41640de2952847f1bdd2a8ef130cd32f" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 45445 } } }
I20260812 06:13:23.483692 7366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:23.483937 7364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41640de2952847f1bdd2a8ef130cd32f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41640de2952847f1bdd2a8ef130cd32f" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 45445 } } }
I20260812 06:13:23.484061 7364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:23.484230 7376 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:23.485005 7376 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:23.486508 7361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:23.474600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40006 (local address 127.0.176.254:45445)
0812 06:13:23.474806 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:23.474816 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:23.474869 (+ 53us) server_negotiation.cc:407] Connection header received
0812 06:13:23.475282 (+ 413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:23.475288 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:23.475335 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:23.475601 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:23.476591 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:23.477672 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:23.478781 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:23.479447 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:23.479581 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:23.482165 (+ 2584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:23.482169 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:23.482170 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:23.482184 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:23.484584 (+ 2400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:23.485059 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:23.485063 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:23.485063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:23.485177 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:23.485436 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:23.485437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:23.485437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:23.485778 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:23.485929 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:23.486134 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 06:13:23.486286 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":94,"threads_started":1}
I20260812 06:13:23.487205 7376 catalog_manager.cc:1347] Generated new cluster ID: e206ed97f26e40ecbc82ad46d740452f
I20260812 06:13:23.487295 7376 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:23.500154 7376 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:23.500797 7376 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:23.509861 7376 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f: Generated new TSK 0
I20260812 06:13:23.510110 7376 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:13:23.545647 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:45445
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:43759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:23.647653 7398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:23.647886 7398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:23.647913 7398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:23.649080 7398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:23.649124 7398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:23.649152 7398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:23.650755 7398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:43759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:45445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:23.650972 7398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:23.651171 7398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:23.656423 7409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:23.656505 7405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:23.656423 7406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:23.656641 7398 server_base.cc:1034] running on GCE node
I20260812 06:13:23.656955 7398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:23.657236 7398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:23.658447 7398 hybrid_clock.cc:648] HybridClock initialized: now 1786515203658439 us; error 40 us; skew 500 ppm
Aug 12 06:13:23 dist-test-slave-gw5c krb5kdc[7215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515203, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:23.661989 7398 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:13:23.662432 7398 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:23.662515 7398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:23.662683 7398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:23.663928 7398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "86ca640d374d4f79bd3b39531a11c5e8"
format_stamp: "Formatted at 2026-08-12 06:13:23 on dist-test-slave-gw5c"
server_key: "ef09cf11adb57d1d2e0613ff5b365b95"
server_key_iv: "e2e4571d40368a907072c724efcdde49"
server_key_version: "encryptionkey@0"
I20260812 06:13:23.664340 7398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "86ca640d374d4f79bd3b39531a11c5e8"
format_stamp: "Formatted at 2026-08-12 06:13:23 on dist-test-slave-gw5c"
server_key: "ef09cf11adb57d1d2e0613ff5b365b95"
server_key_iv: "e2e4571d40368a907072c724efcdde49"
server_key_version: "encryptionkey@0"
I20260812 06:13:23.665871 7398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:23.667016 7423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:23.667340 7398 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:23.667500 7398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "86ca640d374d4f79bd3b39531a11c5e8"
format_stamp: "Formatted at 2026-08-12 06:13:23 on dist-test-slave-gw5c"
server_key: "ef09cf11adb57d1d2e0613ff5b365b95"
server_key_iv: "e2e4571d40368a907072c724efcdde49"
server_key_version: "encryptionkey@0"
I20260812 06:13:23.667598 7398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:23.678367 7398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:23.680752 7398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:23.680970 7398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:23.681262 7398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:23.681635 7398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:23.681694 7398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:23.681730 7398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:23.681773 7398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:23.688278 7398 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:35667
I20260812 06:13:23.688373 7602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:35667 every 8 connection(s)
I20260812 06:13:23.688683 7398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:23.692891 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 7398
I20260812 06:13:23.693043 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:23.693248 707 external_mini_cluster.cc:1428] Setting key c523e53b879f5737042c39d5711c71bf
Aug 12 06:13:23 dist-test-slave-gw5c krb5kdc[7215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515203, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:23.699141 7361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:23.689508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:59359 (local address 127.0.176.254:45445)
0812 06:13:23.689581 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:23.689583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:23.689810 (+ 227us) server_negotiation.cc:407] Connection header received
0812 06:13:23.690293 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:23.690294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:23.690305 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:23.690371 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:23.691593 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:23.692142 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:23.693228 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:23.693566 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:23.693633 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:23.696125 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:23.696127 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:23.696127 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:23.696135 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:23.697619 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:23.698075 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:23.698077 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:23.698077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:23.698143 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:23.698412 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:23.698413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:23.698414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:23.698541 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:23.698620 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:23.698925 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 06:13:23.699045 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:13:23.699429 7605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:23.689488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:45445 (local address 127.0.176.193:59359)
0812 06:13:23.689686 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:23.689724 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:23.690209 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:23.690449 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:23.690452 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:23.690749 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:23.691266 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:23.691271 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:23.692241 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:23.692242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:23.693150 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:23.693153 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:23.693658 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:23.693659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:23.693809 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:23.694429 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:23.694446 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:23.696009 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:23.697729 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:23.697738 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:23.697741 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:23.697994 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:23.698215 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:23.698216 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:23.698216 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:23.698338 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:23.698611 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:23.698619 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:23.698772 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 06:13:23.698900 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 06:13:23.699086 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":110,"threads_started":1}
I20260812 06:13:23.699990 7603 heartbeater.cc:347] Connected to a master server at 127.0.176.254:45445
I20260812 06:13:23.700095 7603 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:23.700284 7603 heartbeater.cc:511] Master 127.0.176.254:45445 requested a full tablet report, sending...
I20260812 06:13:23.700922 7295 ts_manager.cc:194] Registered new tserver with Master: 86ca640d374d4f79bd3b39531a11c5e8 (127.0.176.193:35667)
I20260812 06:13:23.701898 7295 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:59359
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:13:23.722540 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:45445
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:43759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:23.812613 7608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:23.812853 7608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:23.812889 7608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:23.814101 7608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:23.814150 7608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:23.814179 7608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:23.815858 7608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:43759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:45445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:23.816102 7608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:23.816320 7608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:23.821633 7619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:23.821633 7620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:23.821712 7625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:23.821972 7608 server_base.cc:1034] running on GCE node
I20260812 06:13:23.822252 7608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:23.822517 7608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:23.823710 7608 hybrid_clock.cc:648] HybridClock initialized: now 1786515203823704 us; error 40 us; skew 500 ppm
Aug 12 06:13:23 dist-test-slave-gw5c krb5kdc[7215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515203, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:23.827800 7608 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:13:23.828325 7608 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:23.828409 7608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:23.828815 7608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:23.830142 7608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "b9440ff747934644ab77fa9166c3eec0"
format_stamp: "Formatted at 2026-08-12 06:13:23 on dist-test-slave-gw5c"
server_key: "1d0cac3f9105f56d8dd47c55a1a178fb"
server_key_iv: "1a04f359ba60650559a61d698ccd7b6e"
server_key_version: "encryptionkey@0"
I20260812 06:13:23.830559 7608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "b9440ff747934644ab77fa9166c3eec0"
format_stamp: "Formatted at 2026-08-12 06:13:23 on dist-test-slave-gw5c"
server_key: "1d0cac3f9105f56d8dd47c55a1a178fb"
server_key_iv: "1a04f359ba60650559a61d698ccd7b6e"
server_key_version: "encryptionkey@0"
I20260812 06:13:23.832636 7608 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260812 06:13:23.833515 7634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:23.833825 7608 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:23.833948 7608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "b9440ff747934644ab77fa9166c3eec0"
format_stamp: "Formatted at 2026-08-12 06:13:23 on dist-test-slave-gw5c"
server_key: "1d0cac3f9105f56d8dd47c55a1a178fb"
server_key_iv: "1a04f359ba60650559a61d698ccd7b6e"
server_key_version: "encryptionkey@0"
I20260812 06:13:23.834038 7608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:23.854081 7608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:23.856532 7608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:23.856736 7608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:23.857007 7608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:23.857362 7608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:23.857420 7608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:23.857467 7608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:23.857498 7608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:23.864861 7608 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:37755
I20260812 06:13:23.864892 7830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:37755 every 8 connection(s)
I20260812 06:13:23.865198 7608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:13:23.869671 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 7608
I20260812 06:13:23.869819 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:13:23.870052 707 external_mini_cluster.cc:1428] Setting key 37268615bb2fdf47a7fe567f8b8b52d1
Aug 12 06:13:23 dist-test-slave-gw5c krb5kdc[7215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515203, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:23.876060 7361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:23.866023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:51093 (local address 127.0.176.254:45445)
0812 06:13:23.866086 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:23.866088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:23.866291 (+ 203us) server_negotiation.cc:407] Connection header received
0812 06:13:23.866786 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:23.866788 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:23.866800 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:23.866867 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:23.867931 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:23.868482 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:23.869565 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:23.869880 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:23.869980 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:23.872603 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:23.872605 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:23.872605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:23.872616 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:23.874229 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:23.874817 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:23.874818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:23.874818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:23.874879 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:23.875240 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:23.875242 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:23.875242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:23.875440 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:23.875521 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:23.875840 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 06:13:23.875943 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:13:23.876158 7837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:23.865932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:45445 (local address 127.0.176.194:51093)
0812 06:13:23.866118 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:23.866166 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:23.866691 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:23.866925 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:23.866928 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:23.867217 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:23.867812 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:23.867818 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:23.868613 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:23.868614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:23.869461 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:23.869465 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:23.869986 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:23.869987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:23.870121 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:23.870912 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:23.870921 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:23.872486 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:23.874337 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:23.874348 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:23.874352 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:23.874719 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:23.874959 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:23.874960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:23.874961 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:23.875146 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:23.875513 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:23.875522 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:23.875675 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 06:13:23.875784 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 06:13:23.875937 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":104,"threads_started":1}
I20260812 06:13:23.876843 7835 heartbeater.cc:347] Connected to a master server at 127.0.176.254:45445
I20260812 06:13:23.876966 7835 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:23.877190 7835 heartbeater.cc:511] Master 127.0.176.254:45445 requested a full tablet report, sending...
I20260812 06:13:23.877704 7295 ts_manager.cc:194] Registered new tserver with Master: b9440ff747934644ab77fa9166c3eec0 (127.0.176.194:37755)
I20260812 06:13:23.878247 7295 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:51093
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:13:23.898586 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:45445
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:43759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:23.986079 7842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:23.986384 7842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:23.986439 7842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:23.987895 7842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:23.987954 7842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:23.987985 7842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:23.989645 7842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:43759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:45445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:23.989886 7842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:23.990099 7842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:23.995443 7856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:23.995443 7852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:23.995476 7853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:23.995747 7842 server_base.cc:1034] running on GCE node
I20260812 06:13:23.996335 7842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:23.996635 7842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:23.997843 7842 hybrid_clock.cc:648] HybridClock initialized: now 1786515203997831 us; error 33 us; skew 500 ppm
Aug 12 06:13:23 dist-test-slave-gw5c krb5kdc[7215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515203, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:24.000777 7842 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:13:24.001206 7842 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:24.001267 7842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:24.001372 7842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:24.002518 7842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "8182136702ff4d3b8d22f95f59be215d"
format_stamp: "Formatted at 2026-08-12 06:13:23 on dist-test-slave-gw5c"
server_key: "0167cc32a3e7c66482b9ed464902b9f3"
server_key_iv: "d11096f54f70c1f0451fc2261404432c"
server_key_version: "encryptionkey@0"
I20260812 06:13:24.002846 7842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "8182136702ff4d3b8d22f95f59be215d"
format_stamp: "Formatted at 2026-08-12 06:13:23 on dist-test-slave-gw5c"
server_key: "0167cc32a3e7c66482b9ed464902b9f3"
server_key_iv: "d11096f54f70c1f0451fc2261404432c"
server_key_version: "encryptionkey@0"
I20260812 06:13:24.004434 7842 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:24.005558 7863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:24.005812 7842 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:24.005915 7842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "8182136702ff4d3b8d22f95f59be215d"
format_stamp: "Formatted at 2026-08-12 06:13:23 on dist-test-slave-gw5c"
server_key: "0167cc32a3e7c66482b9ed464902b9f3"
server_key_iv: "d11096f54f70c1f0451fc2261404432c"
server_key_version: "encryptionkey@0"
I20260812 06:13:24.005990 7842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:24.030198 7842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:24.032752 7842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:24.032884 7842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:24.033105 7842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:24.033484 7842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:24.033524 7842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:24.033547 7842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:24.033592 7842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:24.039980 7842 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:39763
I20260812 06:13:24.040011 8073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:39763 every 8 connection(s)
I20260812 06:13:24.040419 7842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:13:24.045719 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 7842
I20260812 06:13:24.045928 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:13:24.046151 707 external_mini_cluster.cc:1428] Setting key 2b4de61889cdec4ea893c76c632893d9
Aug 12 06:13:24 dist-test-slave-gw5c krb5kdc[7215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515203, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:24.053849 7361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.041656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:38721 (local address 127.0.176.254:45445)
0812 06:13:24.041792 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:24.041795 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:24.042006 (+ 211us) server_negotiation.cc:407] Connection header received
0812 06:13:24.042624 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:24.042625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:24.042641 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:24.042716 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:24.043959 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.044487 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.045535 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.045751 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.045851 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.049487 (+ 3636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:24.049490 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:24.049490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:24.049501 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:24.051743 (+ 2242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:24.052363 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:24.052365 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:24.052365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:24.052443 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:24.052743 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:24.052744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:24.052744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:24.052908 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:24.053175 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:24.053612 (+ 437us) server_negotiation.cc:299] Negotiation successful
0812 06:13:24.053745 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 06:13:24.054067 8081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.041568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:45445 (local address 127.0.176.195:38721)
0812 06:13:24.041845 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:24.041909 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:24.042496 (+ 587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:24.042807 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:24.042811 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:24.043113 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:24.043823 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:24.043829 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.044591 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.044592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:24.045427 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:24.045430 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.045851 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.045852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:24.045990 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.046821 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:24.046837 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:24.049283 (+ 2446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:24.051894 (+ 2611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:24.051907 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:24.051911 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:24.052262 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:24.052529 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:24.052530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:24.052531 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:24.052670 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:24.053164 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:24.053179 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:24.053407 (+ 228us) client_negotiation.cc:769] Sending connection context
0812 06:13:24.053551 (+ 144us) client_negotiation.cc:240] Negotiation successful
0812 06:13:24.053794 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":110,"threads_started":1}
I20260812 06:13:24.054637 8076 heartbeater.cc:347] Connected to a master server at 127.0.176.254:45445
I20260812 06:13:24.054733 8076 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:24.054873 8076 heartbeater.cc:511] Master 127.0.176.254:45445 requested a full tablet report, sending...
I20260812 06:13:24.055255 7295 ts_manager.cc:194] Registered new tserver with Master: 8182136702ff4d3b8d22f95f59be215d (127.0.176.195:39763)
I20260812 06:13:24.055934 7295 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:38721
I20260812 06:13:24.058518 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:13:24.066658 7361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.060087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40010 (local address 127.0.176.254:45445)
0812 06:13:24.060152 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:24.060154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:24.060220 (+ 66us) server_negotiation.cc:407] Connection header received
0812 06:13:24.060281 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:24.060282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:24.060291 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:24.060335 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:24.060944 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.061449 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.062176 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.062467 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.062545 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.063984 (+ 1439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:24.063985 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:24.063985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:24.063993 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:24.065409 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:24.065754 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:24.065755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:24.065755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:24.065807 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:24.066021 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:24.066021 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:24.066021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:24.066180 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:24.066262 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:24.066410 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 06:13:24.066487 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:13:24.069038 7295 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40010:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:13:24.071448 7295 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:24.080629 8103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.074571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43372 (local address 127.0.176.193:35667)
0812 06:13:24.074848 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:24.074852 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:24.076010 (+ 1158us) server_negotiation.cc:407] Connection header received
0812 06:13:24.076089 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:24.076091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:24.076111 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:24.076198 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:24.076457 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.077674 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.079209 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.080130 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.080205 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.080271 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:24.080477 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 06:13:24.080529 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":101,"threads_started":1}
I20260812 06:13:24.080624 8105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.075751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:35667 (local address 127.0.0.1:43372)
0812 06:13:24.075922 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:24.075932 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:24.076013 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:24.076300 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:24.076301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:24.076305 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:24.076354 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:24.076355 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.077790 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.077791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:24.079095 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:24.079098 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.080304 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.080305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:24.080358 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.080360 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:13:24.080429 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:13:24.080520 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":48,"thread_start_us":117,"threads_started":1}
I20260812 06:13:24.080837 8101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.074536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48778 (local address 127.0.176.195:39763)
0812 06:13:24.074816 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:24.074821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:24.076032 (+ 1211us) server_negotiation.cc:407] Connection header received
0812 06:13:24.076083 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:24.076086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:24.076106 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:24.076407 (+ 301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:24.076489 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.077479 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.079213 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.080065 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.080151 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.080220 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:24.080678 (+ 458us) server_negotiation.cc:299] Negotiation successful
0812 06:13:24.080734 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":106,"threads_started":1}
I20260812 06:13:24.080965 8106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.076015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:37755 (local address 127.0.0.1:43874)
0812 06:13:24.076139 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:24.076148 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:24.076187 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:24.076648 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:24.076649 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:24.076651 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:24.076722 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:24.076724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.077944 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.077946 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:24.079193 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:24.079197 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.080178 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.080180 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:24.080327 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.080348 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 06:13:24.080429 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 06:13:24.080891 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":405,"thread_start_us":81,"threads_started":1}
I20260812 06:13:24.081081 8098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.074439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:39763 (local address 127.0.0.1:48778)
0812 06:13:24.075791 (+ 1352us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:24.075843 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:24.075932 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:24.076221 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:24.076224 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:24.076227 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:24.076315 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:24.076318 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.077564 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.077565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:24.079095 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:24.079098 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.080468 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.080469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:24.080522 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.080525 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:24.080571 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 06:13:24.080612 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1313,"mutex_wait_us":86,"thread_start_us":99,"threads_started":1}
I20260812 06:13:24.080662 8107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.076275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43874 (local address 127.0.176.194:37755)
0812 06:13:24.076495 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:24.076500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:24.076511 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:24.076549 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:24.076550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:24.076567 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:24.076649 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:24.076794 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.077822 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.079279 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.080066 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.080151 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.080220 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:24.080482 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 06:13:24.080553 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":99,"threads_started":1}
I20260812 06:13:24.081728 7502 tablet_service.cc:1467] Processing CreateTablet for tablet 83533b80f17f40bdbe05e75cdf7eadd3 (DEFAULT_TABLE table=test-table [id=070977ace612427db8edbe972901f7e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:24.081799 7954 tablet_service.cc:1467] Processing CreateTablet for tablet 83533b80f17f40bdbe05e75cdf7eadd3 (DEFAULT_TABLE table=test-table [id=070977ace612427db8edbe972901f7e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:24.082213 7954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83533b80f17f40bdbe05e75cdf7eadd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:24.082235 7502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83533b80f17f40bdbe05e75cdf7eadd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:24.082183 7728 tablet_service.cc:1467] Processing CreateTablet for tablet 83533b80f17f40bdbe05e75cdf7eadd3 (DEFAULT_TABLE table=test-table [id=070977ace612427db8edbe972901f7e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:24.082508 7728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83533b80f17f40bdbe05e75cdf7eadd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:24.086987 8110 tablet_bootstrap.cc:492] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8: Bootstrap starting.
I20260812 06:13:24.087798 8110 tablet_bootstrap.cc:654] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:24.088501 8110 log.cc:824] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:24.089433 8110 tablet_bootstrap.cc:492] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8: No bootstrap required, opened a new log
I20260812 06:13:24.089530 8110 ts_tablet_manager.cc:1397] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:13:24.090293 8113 tablet_bootstrap.cc:492] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0: Bootstrap starting.
I20260812 06:13:24.090523 8109 tablet_bootstrap.cc:492] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d: Bootstrap starting.
I20260812 06:13:24.091292 8113 tablet_bootstrap.cc:654] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:24.091300 8109 tablet_bootstrap.cc:654] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:24.091970 8113 log.cc:824] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:24.092075 8109 log.cc:824] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:24.091984 8110 raft_consensus.cc:348] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8182136702ff4d3b8d22f95f59be215d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39763 } } peers { permanent_uuid: "86ca640d374d4f79bd3b39531a11c5e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35667 } } peers { permanent_uuid: "b9440ff747934644ab77fa9166c3eec0" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37755 } }
I20260812 06:13:24.092192 8110 raft_consensus.cc:374] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:24.092240 8110 raft_consensus.cc:729] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ca640d374d4f79bd3b39531a11c5e8, State: Initialized, Role: FOLLOWER
I20260812 06:13:24.092432 8110 consensus_queue.cc:260] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8182136702ff4d3b8d22f95f59be215d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39763 } } peers { permanent_uuid: "86ca640d374d4f79bd3b39531a11c5e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35667 } } peers { permanent_uuid: "b9440ff747934644ab77fa9166c3eec0" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37755 } }
I20260812 06:13:24.092787 8110 ts_tablet_manager.cc:1428] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 06:13:24.092931 7603 heartbeater.cc:503] Master 127.0.176.254:45445 was elected leader, sending a full tablet report...
I20260812 06:13:24.092931 8113 tablet_bootstrap.cc:492] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0: No bootstrap required, opened a new log
I20260812 06:13:24.092949 8109 tablet_bootstrap.cc:492] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d: No bootstrap required, opened a new log
I20260812 06:13:24.093024 8109 ts_tablet_manager.cc:1397] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:13:24.093026 8113 ts_tablet_manager.cc:1397] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:13:24.094854 8113 raft_consensus.cc:348] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8182136702ff4d3b8d22f95f59be215d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39763 } } peers { permanent_uuid: "86ca640d374d4f79bd3b39531a11c5e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35667 } } peers { permanent_uuid: "b9440ff747934644ab77fa9166c3eec0" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37755 } }
I20260812 06:13:24.095067 8113 raft_consensus.cc:374] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:24.094976 8109 raft_consensus.cc:348] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8182136702ff4d3b8d22f95f59be215d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39763 } } peers { permanent_uuid: "86ca640d374d4f79bd3b39531a11c5e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35667 } } peers { permanent_uuid: "b9440ff747934644ab77fa9166c3eec0" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37755 } }
I20260812 06:13:24.095109 8113 raft_consensus.cc:729] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9440ff747934644ab77fa9166c3eec0, State: Initialized, Role: FOLLOWER
I20260812 06:13:24.095147 8109 raft_consensus.cc:374] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:24.095189 8109 raft_consensus.cc:729] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8182136702ff4d3b8d22f95f59be215d, State: Initialized, Role: FOLLOWER
I20260812 06:13:24.095242 8113 consensus_queue.cc:260] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8182136702ff4d3b8d22f95f59be215d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39763 } } peers { permanent_uuid: "86ca640d374d4f79bd3b39531a11c5e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35667 } } peers { permanent_uuid: "b9440ff747934644ab77fa9166c3eec0" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37755 } }
I20260812 06:13:24.095309 8109 consensus_queue.cc:260] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8182136702ff4d3b8d22f95f59be215d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39763 } } peers { permanent_uuid: "86ca640d374d4f79bd3b39531a11c5e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35667 } } peers { permanent_uuid: "b9440ff747934644ab77fa9166c3eec0" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37755 } }
I20260812 06:13:24.095651 8109 ts_tablet_manager.cc:1428] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:13:24.095790 8113 ts_tablet_manager.cc:1428] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:13:24.095820 8076 heartbeater.cc:503] Master 127.0.176.254:45445 was elected leader, sending a full tablet report...
I20260812 06:13:24.095819 7835 heartbeater.cc:503] Master 127.0.176.254:45445 was elected leader, sending a full tablet report...
W20260812 06:13:24.115950 7836 tablet.cc:2369] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:13:24.189580 7604 tablet.cc:2369] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:13:24.291246 8079 tablet.cc:2369] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:13:24.433941 8121 raft_consensus.cc:482] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:24.434088 8121 raft_consensus.cc:504] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8182136702ff4d3b8d22f95f59be215d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39763 } } peers { permanent_uuid: "86ca640d374d4f79bd3b39531a11c5e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35667 } } peers { permanent_uuid: "b9440ff747934644ab77fa9166c3eec0" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37755 } }
I20260812 06:13:24.434477 8121 leader_election.cc:288] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ca640d374d4f79bd3b39531a11c5e8 (127.0.176.193:35667), b9440ff747934644ab77fa9166c3eec0 (127.0.176.194:37755)
I20260812 06:13:24.438805 8103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.434835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:43619 (local address 127.0.176.193:35667)
0812 06:13:24.434886 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:24.434888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:24.434906 (+ 18us) server_negotiation.cc:407] Connection header received
0812 06:13:24.434972 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:24.434973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:24.434984 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:24.435074 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:24.435242 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.436050 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.437752 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.438322 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.438415 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.438425 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:24.438682 (+ 257us) server_negotiation.cc:299] Negotiation successful
0812 06:13:24.438726 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:13:24.438805 8107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.434986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:40205 (local address 127.0.176.194:37755)
0812 06:13:24.435030 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:24.435031 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:24.435111 (+ 80us) server_negotiation.cc:407] Connection header received
0812 06:13:24.435164 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:24.435165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:24.435175 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:24.435252 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:24.435475 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.436142 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.437744 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.438341 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.438415 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.438425 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:24.438682 (+ 257us) server_negotiation.cc:299] Negotiation successful
0812 06:13:24.438737 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:13:24.438827 8081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.434752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:35667 (local address 127.0.176.195:43619)
0812 06:13:24.434833 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:24.434846 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:24.434895 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:24.435092 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:24.435093 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:24.435095 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:24.435175 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:24.435177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.436159 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.436160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:24.437588 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:24.437591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.438462 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.438463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:24.438565 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.438567 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:13:24.438644 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 06:13:24.438696 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":63}
I20260812 06:13:24.438834 8122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.434876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:37755 (local address 127.0.176.195:40205)
0812 06:13:24.435031 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:24.435063 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:24.435113 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:24.435273 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:24.435273 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:24.435275 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:24.435351 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:24.435352 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.436255 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.436256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:24.437588 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:24.437591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.438463 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.438465 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:24.438558 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.438564 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:13:24.438644 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 06:13:24.438696 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":35,"thread_start_us":109,"threads_started":1}
I20260812 06:13:24.439349 7529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83533b80f17f40bdbe05e75cdf7eadd3" candidate_uuid: "8182136702ff4d3b8d22f95f59be215d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ca640d374d4f79bd3b39531a11c5e8" is_pre_election: true
I20260812 06:13:24.439579 7529 raft_consensus.cc:2454] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8182136702ff4d3b8d22f95f59be215d in term 0.
I20260812 06:13:24.439862 7864 leader_election.cc:302] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8182136702ff4d3b8d22f95f59be215d, 86ca640d374d4f79bd3b39531a11c5e8; no voters:
I20260812 06:13:24.439960 7762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83533b80f17f40bdbe05e75cdf7eadd3" candidate_uuid: "8182136702ff4d3b8d22f95f59be215d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9440ff747934644ab77fa9166c3eec0" is_pre_election: true
I20260812 06:13:24.440032 8121 raft_consensus.cc:2781] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:24.440095 8121 raft_consensus.cc:482] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:24.440124 8121 raft_consensus.cc:3037] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:24.440127 7762 raft_consensus.cc:2454] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8182136702ff4d3b8d22f95f59be215d in term 0.
I20260812 06:13:24.440968 8121 raft_consensus.cc:504] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8182136702ff4d3b8d22f95f59be215d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39763 } } peers { permanent_uuid: "86ca640d374d4f79bd3b39531a11c5e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35667 } } peers { permanent_uuid: "b9440ff747934644ab77fa9166c3eec0" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37755 } }
I20260812 06:13:24.441129 8121 leader_election.cc:288] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [CANDIDATE]: Term 1 election: Requested vote from peers 86ca640d374d4f79bd3b39531a11c5e8 (127.0.176.193:35667), b9440ff747934644ab77fa9166c3eec0 (127.0.176.194:37755)
I20260812 06:13:24.441416 7762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83533b80f17f40bdbe05e75cdf7eadd3" candidate_uuid: "8182136702ff4d3b8d22f95f59be215d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9440ff747934644ab77fa9166c3eec0"
I20260812 06:13:24.441416 7529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83533b80f17f40bdbe05e75cdf7eadd3" candidate_uuid: "8182136702ff4d3b8d22f95f59be215d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ca640d374d4f79bd3b39531a11c5e8"
I20260812 06:13:24.441519 7762 raft_consensus.cc:3037] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:24.441519 7529 raft_consensus.cc:3037] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:24.442521 7762 raft_consensus.cc:2454] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8182136702ff4d3b8d22f95f59be215d in term 1.
I20260812 06:13:24.442520 7529 raft_consensus.cc:2454] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8182136702ff4d3b8d22f95f59be215d in term 1.
I20260812 06:13:24.442776 7864 leader_election.cc:302] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8182136702ff4d3b8d22f95f59be215d, 86ca640d374d4f79bd3b39531a11c5e8; no voters:
I20260812 06:13:24.442903 8121 raft_consensus.cc:2781] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:24.443097 8121 raft_consensus.cc:686] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [term 1 LEADER]: Becoming Leader. State: Replica: 8182136702ff4d3b8d22f95f59be215d, State: Running, Role: LEADER
I20260812 06:13:24.443338 8121 consensus_queue.cc:237] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8182136702ff4d3b8d22f95f59be215d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39763 } } peers { permanent_uuid: "86ca640d374d4f79bd3b39531a11c5e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35667 } } peers { permanent_uuid: "b9440ff747934644ab77fa9166c3eec0" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37755 } }
I20260812 06:13:24.444630 7295 catalog_manager.cc:5495] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8182136702ff4d3b8d22f95f59be215d (127.0.176.195). New cstate: current_term: 1 leader_uuid: "8182136702ff4d3b8d22f95f59be215d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8182136702ff4d3b8d22f95f59be215d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ca640d374d4f79bd3b39531a11c5e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9440ff747934644ab77fa9166c3eec0" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260812 06:13:24.529187 8101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.526526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40426 (local address 127.0.176.195:39763)
0812 06:13:24.526597 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:24.526600 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:24.526609 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:24.526678 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:24.526679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:24.526702 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:24.526809 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:24.527020 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.527599 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.528406 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:24.528603 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:24.528660 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:24.528820 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:24.528932 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:24.528994 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:24.529029 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 06:13:24.529049 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 06:13:24.531142 7529 raft_consensus.cc:1261] T 83533b80f17f40bdbe05e75cdf7eadd3 P 86ca640d374d4f79bd3b39531a11c5e8 [term 1 FOLLOWER]: Refusing update from remote peer 8182136702ff4d3b8d22f95f59be215d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:24.531138 7762 raft_consensus.cc:1261] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0 [term 1 FOLLOWER]: Refusing update from remote peer 8182136702ff4d3b8d22f95f59be215d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:24.531546 8124 consensus_queue.cc:1035] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9440ff747934644ab77fa9166c3eec0" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:24.531697 8121 consensus_queue.cc:1035] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ca640d374d4f79bd3b39531a11c5e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:24.534508 8135 mvcc.cc:205] Tried to move back new op lower bound from 7317566277756534784 to 7317566277401161728. Current Snapshot: MvccSnapshot[applied={T|T < 7317566277756534784}]
I20260812 06:13:24.535117 8136 mvcc.cc:205] Tried to move back new op lower bound from 7317566277756534784 to 7317566277401161728. Current Snapshot: MvccSnapshot[applied={T|T < 7317566277756534784}]
I20260812 06:13:24.536486 7295 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:24.536615 7295 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:24.537472 7295 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 41640de2952847f1bdd2a8ef130cd32f: Sending DeleteTablet for 3 replicas of tablet 83533b80f17f40bdbe05e75cdf7eadd3
I20260812 06:13:24.537869 7954 tablet_service.cc:1514] Processing DeleteTablet for tablet 83533b80f17f40bdbe05e75cdf7eadd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:24 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:48778
I20260812 06:13:24.538053 7502 tablet_service.cc:1514] Processing DeleteTablet for tablet 83533b80f17f40bdbe05e75cdf7eadd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:24 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:43372
I20260812 06:13:24.538210 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 7398
I20260812 06:13:24.538380 7728 tablet_service.cc:1514] Processing DeleteTablet for tablet 83533b80f17f40bdbe05e75cdf7eadd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:24 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:43874
I20260812 06:13:24.545305 8155 tablet_replica.cc:330] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0: stopping tablet replica
I20260812 06:13:24.545493 8155 raft_consensus.cc:2229] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:24.545631 8155 raft_consensus.cc:2258] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:24.550729 8155 ts_tablet_manager.cc:1905] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:24.553323 8151 tablet_replica.cc:330] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d: stopping tablet replica
I20260812 06:13:24.553499 8151 raft_consensus.cc:2229] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:13:24.553649 8151 raft_consensus.cc:2258] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:24.555203 8151 ts_tablet_manager.cc:1905] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:24.557641 8151 ts_tablet_manager.cc:1918] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:24.557744 8151 log.cc:1196] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/83533b80f17f40bdbe05e75cdf7eadd3
I20260812 06:13:24.558075 8151 ts_tablet_manager.cc:1939] T 83533b80f17f40bdbe05e75cdf7eadd3 P 8182136702ff4d3b8d22f95f59be215d: Deleting consensus metadata
I20260812 06:13:24.564738 7267 catalog_manager.cc:4841] TS 8182136702ff4d3b8d22f95f59be215d (127.0.176.195:39763): tablet 83533b80f17f40bdbe05e75cdf7eadd3 (table test-table [id=070977ace612427db8edbe972901f7e9]) successfully deleted
I20260812 06:13:24.567327 8155 ts_tablet_manager.cc:1918] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:24.567507 8155 log.cc:1196] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/83533b80f17f40bdbe05e75cdf7eadd3
I20260812 06:13:24.567795 8155 ts_tablet_manager.cc:1939] T 83533b80f17f40bdbe05e75cdf7eadd3 P b9440ff747934644ab77fa9166c3eec0: Deleting consensus metadata
I20260812 06:13:24.568356 7266 catalog_manager.cc:4841] TS b9440ff747934644ab77fa9166c3eec0 (127.0.176.194:37755): tablet 83533b80f17f40bdbe05e75cdf7eadd3 (table test-table [id=070977ace612427db8edbe972901f7e9]) successfully deleted
W20260812 06:13:24.572540 7266 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:35667 (error 108)
I20260812 06:13:24.572908 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 7608
I20260812 06:13:24.573202 8105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.573062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:35667 (local address 127.0.0.1:37348)
0812 06:13:24.573119 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:24.573159 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:35667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 06:13:24.573323 7266 catalog_manager.cc:4584] TS 86ca640d374d4f79bd3b39531a11c5e8 (127.0.176.193:35667): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 83533b80f17f40bdbe05e75cdf7eadd3: Network error: Client connection negotiation failed: client connection to 127.0.176.193:35667: connect: Connection refused (error 111)
I20260812 06:13:24.589147 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 7842
I20260812 06:13:24.600950 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 7235
2026-08-12T06:13:24Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2713 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T06:13:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:24Z Disabled control of system clock
I20260812 06:13:24.643312 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43165
--webserver_interface=127.0.176.254
--webserver_port=0
--builtin_ntp_servers=127.0.176.212:42945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:43165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 06:13:24.729187 8167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:24.729454 8167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:24.729480 8167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:24.730901 8167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:24.730965 8167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:24.730978 8167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:24.730993 8167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:24.731004 8167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:24.732635 8167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:43165
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:24.732980 8167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:24.733356 8167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:24.738778 8177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:24.738776 8179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:24.739174 8167 server_base.cc:1034] running on GCE node
W20260812 06:13:24.738776 8176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:24.739573 8167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:24.739917 8167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:24.741104 8167 hybrid_clock.cc:648] HybridClock initialized: now 1786515204741090 us; error 33 us; skew 500 ppm
I20260812 06:13:24.742635 8167 webserver.cc:460] Webserver started at http://127.0.176.254:40723/ using document root <none> and password file <none>
I20260812 06:13:24.742909 8167 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:24.742987 8167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:24.743150 8167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:24.744383 8167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "588fe3cab22a46f09d61806de156e334"
format_stamp: "Formatted at 2026-08-12 06:13:24 on dist-test-slave-gw5c"
server_key: "ca25c1047b703bdb0f40fa4d43029180"
server_key_iv: "a559c80d52ebdf48b19e49d50875bb79"
server_key_version: "encryptionkey@0"
I20260812 06:13:24.744793 8167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "588fe3cab22a46f09d61806de156e334"
format_stamp: "Formatted at 2026-08-12 06:13:24 on dist-test-slave-gw5c"
server_key: "ca25c1047b703bdb0f40fa4d43029180"
server_key_iv: "a559c80d52ebdf48b19e49d50875bb79"
server_key_version: "encryptionkey@0"
I20260812 06:13:24.746194 8167 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:13:24.747036 8186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:24.747229 8167 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:24.747341 8167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "588fe3cab22a46f09d61806de156e334"
format_stamp: "Formatted at 2026-08-12 06:13:24 on dist-test-slave-gw5c"
server_key: "ca25c1047b703bdb0f40fa4d43029180"
server_key_iv: "a559c80d52ebdf48b19e49d50875bb79"
server_key_version: "encryptionkey@0"
I20260812 06:13:24.747483 8167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:24.751155 8167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:24.751534 8167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:24.751703 8167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:24.756134 8167 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:43165
I20260812 06:13:24.756184 8283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:43165 every 8 connection(s)
I20260812 06:13:24.756582 8167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:24.757328 8284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:24.758644 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 8167
I20260812 06:13:24.758759 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:24.758975 707 external_mini_cluster.cc:1428] Setting key e00feb2e515a11f1256ad0676928bbaa
I20260812 06:13:24.761363 8284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334: Bootstrap starting.
I20260812 06:13:24.761710 8291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.759662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40948 (local address 127.0.176.254:43165)
0812 06:13:24.759903 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:24.759911 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:24.759939 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:13:24.760373 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:24.760380 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:24.760429 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:24.760544 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:24.761246 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:24.761249 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:24.761250 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:24.761254 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:24.761298 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:24.761308 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:24.761365 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:24.761494 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 06:13:24.761561 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":116,"threads_started":1}
I20260812 06:13:24.762171 8284 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:24.762530 8284 log.cc:824] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:24.763484 8284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334: No bootstrap required, opened a new log
I20260812 06:13:24.764976 8284 raft_consensus.cc:348] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "588fe3cab22a46f09d61806de156e334" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43165 } }
I20260812 06:13:24.765126 8284 raft_consensus.cc:374] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:24.765148 8284 raft_consensus.cc:729] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 588fe3cab22a46f09d61806de156e334, State: Initialized, Role: FOLLOWER
I20260812 06:13:24.765296 8284 consensus_queue.cc:260] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "588fe3cab22a46f09d61806de156e334" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43165 } }
I20260812 06:13:24.765393 8284 raft_consensus.cc:388] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:24.765419 8284 raft_consensus.cc:482] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:24.765492 8284 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:24.766122 8284 raft_consensus.cc:504] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "588fe3cab22a46f09d61806de156e334" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43165 } }
I20260812 06:13:24.766215 8284 leader_election.cc:302] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 588fe3cab22a46f09d61806de156e334; no voters:
I20260812 06:13:24.766429 8284 leader_election.cc:288] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:24.766774 8284 sys_catalog.cc:564] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:24.766777 8296 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:24.766987 8296 raft_consensus.cc:686] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [term 1 LEADER]: Becoming Leader. State: Replica: 588fe3cab22a46f09d61806de156e334, State: Running, Role: LEADER
I20260812 06:13:24.767097 8296 consensus_queue.cc:237] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "588fe3cab22a46f09d61806de156e334" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43165 } }
I20260812 06:13:24.767505 8299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "588fe3cab22a46f09d61806de156e334" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "588fe3cab22a46f09d61806de156e334" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43165 } } }
I20260812 06:13:24.767508 8302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 588fe3cab22a46f09d61806de156e334. Latest consensus state: current_term: 1 leader_uuid: "588fe3cab22a46f09d61806de156e334" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "588fe3cab22a46f09d61806de156e334" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43165 } } }
I20260812 06:13:24.767638 8299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:24.767645 8302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:24.767858 8309 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:24.768429 8309 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:24.770051 8309 catalog_manager.cc:1347] Generated new cluster ID: 37dcc82db2a642d3930ea6253a0c2328
I20260812 06:13:24.770116 8309 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:24.778287 8309 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:24.778512 8309 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:24.783053 8309 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334: Generated new TSK 0
I20260812 06:13:24.783305 8309 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:13:24.790230 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43165
--builtin_ntp_servers=127.0.176.212:42945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 06:13:24.887918 8325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:24.888139 8325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:24.888166 8325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:24.889453 8325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:24.889499 8325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:24.889529 8325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:24.891611 8325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:24.891906 8325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:24.892258 8325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:24.898581 8332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:24.898587 8330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:24.899010 8325 server_base.cc:1034] running on GCE node
W20260812 06:13:24.898581 8334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:24.899312 8325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:24.899637 8325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:24.900841 8325 hybrid_clock.cc:648] HybridClock initialized: now 1786515204900822 us; error 32 us; skew 500 ppm
I20260812 06:13:24.902276 8325 webserver.cc:460] Webserver started at http://127.0.176.193:34965/ using document root <none> and password file <none>
I20260812 06:13:24.902567 8325 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:24.902645 8325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:24.902817 8325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:24.904202 8325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "6a43d848969e45d68e68f56c072920f4"
format_stamp: "Formatted at 2026-08-12 06:13:24 on dist-test-slave-gw5c"
server_key: "1e53791a0b2678aa6c26c832bbc97ca7"
server_key_iv: "15e9539a4cea3a0f1c72d9f8e0540b38"
server_key_version: "encryptionkey@0"
I20260812 06:13:24.904672 8325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "6a43d848969e45d68e68f56c072920f4"
format_stamp: "Formatted at 2026-08-12 06:13:24 on dist-test-slave-gw5c"
server_key: "1e53791a0b2678aa6c26c832bbc97ca7"
server_key_iv: "15e9539a4cea3a0f1c72d9f8e0540b38"
server_key_version: "encryptionkey@0"
I20260812 06:13:24.906247 8325 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:24.907200 8346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:24.907457 8325 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:24.907562 8325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "6a43d848969e45d68e68f56c072920f4"
format_stamp: "Formatted at 2026-08-12 06:13:24 on dist-test-slave-gw5c"
server_key: "1e53791a0b2678aa6c26c832bbc97ca7"
server_key_iv: "15e9539a4cea3a0f1c72d9f8e0540b38"
server_key_version: "encryptionkey@0"
I20260812 06:13:24.907639 8325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:24.911903 8325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:24.912173 8325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:24.912286 8325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:24.912599 8325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:24.912937 8325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:24.912973 8325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:24.912997 8325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:24.913009 8325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:24.921612 8325 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:45115
I20260812 06:13:24.921814 8537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:45115 every 8 connection(s)
I20260812 06:13:24.922108 8325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:24.926509 8291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.922960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:39151 (local address 127.0.176.254:43165)
0812 06:13:24.923033 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:24.923036 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:24.923357 (+ 321us) server_negotiation.cc:407] Connection header received
0812 06:13:24.924175 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:24.924176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:24.924182 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:24.924232 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:24.926025 (+ 1793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:24.926026 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:24.926027 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:24.926031 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:24.926047 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:24.926051 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:24.926102 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:24.926433 (+ 331us) server_negotiation.cc:299] Negotiation successful
0812 06:13:24.926448 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:13:24.926842 8540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:24.922955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43165 (local address 127.0.176.193:39151)
0812 06:13:24.923204 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:24.923251 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:24.924054 (+ 803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:24.924604 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:24.924608 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:24.924621 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:24.925816 (+ 1195us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:13:24.925816 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:24.925859 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:13:24.925898 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:24.926122 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:24.926129 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:24.926132 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:24.926425 (+ 293us) client_negotiation.cc:240] Negotiation successful
0812 06:13:24.926498 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":99,"threads_started":1}
I20260812 06:13:24.927558 8538 heartbeater.cc:347] Connected to a master server at 127.0.176.254:43165
I20260812 06:13:24.927647 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 8325
I20260812 06:13:24.927691 8538 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:24.927767 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:24.927867 8538 heartbeater.cc:511] Master 127.0.176.254:43165 requested a full tablet report, sending...
I20260812 06:13:24.928004 707 external_mini_cluster.cc:1428] Setting key 34795330210c5280460ce21891e3568d
I20260812 06:13:24.928470 8218 ts_manager.cc:194] Registered new tserver with Master: 6a43d848969e45d68e68f56c072920f4 (127.0.176.193:45115)
I20260812 06:13:24.929180 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43165
--builtin_ntp_servers=127.0.176.212:42945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 06:13:25.085582 8541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:25.085827 8541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:25.085852 8541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:25.087059 8541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:25.087105 8541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:25.087131 8541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:25.088558 8541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:25.088852 8541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:25.089180 8541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:25.094317 8558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:25.094339 8554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:25.094372 8563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:25.094596 8541 server_base.cc:1034] running on GCE node
I20260812 06:13:25.094858 8541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:25.095132 8541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:25.096324 8541 hybrid_clock.cc:648] HybridClock initialized: now 1786515205096299 us; error 51 us; skew 500 ppm
I20260812 06:13:25.097770 8541 webserver.cc:460] Webserver started at http://127.0.176.194:38245/ using document root <none> and password file <none>
I20260812 06:13:25.098042 8541 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:25.098115 8541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:25.098276 8541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:25.099542 8541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "fb1bee4f3f024b61b495e3d9af52f0a7"
format_stamp: "Formatted at 2026-08-12 06:13:25 on dist-test-slave-gw5c"
server_key: "367c2daee71e9de367d859248ebe7764"
server_key_iv: "809c6032be0a2ec9b693ba16deca8f92"
server_key_version: "encryptionkey@0"
I20260812 06:13:25.099959 8541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "fb1bee4f3f024b61b495e3d9af52f0a7"
format_stamp: "Formatted at 2026-08-12 06:13:25 on dist-test-slave-gw5c"
server_key: "367c2daee71e9de367d859248ebe7764"
server_key_iv: "809c6032be0a2ec9b693ba16deca8f92"
server_key_version: "encryptionkey@0"
I20260812 06:13:25.101476 8541 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:25.102334 8571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:25.102646 8541 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:25.102749 8541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "fb1bee4f3f024b61b495e3d9af52f0a7"
format_stamp: "Formatted at 2026-08-12 06:13:25 on dist-test-slave-gw5c"
server_key: "367c2daee71e9de367d859248ebe7764"
server_key_iv: "809c6032be0a2ec9b693ba16deca8f92"
server_key_version: "encryptionkey@0"
I20260812 06:13:25.102818 8541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:25.106777 8541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:25.107105 8541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:25.107257 8541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:25.107513 8541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:25.107901 8541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:25.107951 8541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:25.107985 8541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:25.108016 8541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:25.117131 8541 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:37845
I20260812 06:13:25.117255 8763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:37845 every 8 connection(s)
I20260812 06:13:25.117605 8541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:13:25.121243 8291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.118452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:45461 (local address 127.0.176.254:43165)
0812 06:13:25.118526 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:25.118529 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:25.118821 (+ 292us) server_negotiation.cc:407] Connection header received
0812 06:13:25.119304 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:25.119305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:25.119311 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:25.119366 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:25.120989 (+ 1623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:25.120990 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:25.120990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:25.120995 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:25.121011 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:25.121015 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:25.121092 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:25.121168 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 06:13:25.121181 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:13:25.121440 8768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.118446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43165 (local address 127.0.176.194:45461)
0812 06:13:25.118692 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:25.118729 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:25.119212 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:25.119531 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:25.119535 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:25.119545 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:25.120774 (+ 1229us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:13:25.120775 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:25.120808 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:13:25.120841 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:25.121094 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:25.121099 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:25.121101 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:13:25.121165 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 06:13:25.121219 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":91,"threads_started":1}
I20260812 06:13:25.121973 8764 heartbeater.cc:347] Connected to a master server at 127.0.176.254:43165
I20260812 06:13:25.122077 8764 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:25.122210 8764 heartbeater.cc:511] Master 127.0.176.254:43165 requested a full tablet report, sending...
I20260812 06:13:25.122618 8218 ts_manager.cc:194] Registered new tserver with Master: fb1bee4f3f024b61b495e3d9af52f0a7 (127.0.176.194:37845)
I20260812 06:13:25.127048 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 8541
I20260812 06:13:25.127159 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:13:25.127321 707 external_mini_cluster.cc:1428] Setting key 1c560784cd34b7c94df2730ea4945d4e
I20260812 06:13:25.128726 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43165
--builtin_ntp_servers=127.0.176.212:42945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 06:13:25.228206 8769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:25.228471 8769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:25.228499 8769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:25.229956 8769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:25.230024 8769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:25.230058 8769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:25.231655 8769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:25.231912 8769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:25.232231 8769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:25.238353 8787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:25.238366 8790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:25.238355 8788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:25.238638 8769 server_base.cc:1034] running on GCE node
I20260812 06:13:25.238894 8769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:25.239141 8769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:25.240305 8769 hybrid_clock.cc:648] HybridClock initialized: now 1786515205240289 us; error 46 us; skew 500 ppm
I20260812 06:13:25.241796 8769 webserver.cc:460] Webserver started at http://127.0.176.195:41743/ using document root <none> and password file <none>
I20260812 06:13:25.242105 8769 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:25.242158 8769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:25.242343 8769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:25.243691 8769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "4459c95269dc4eccbbc52e14169ef47a"
format_stamp: "Formatted at 2026-08-12 06:13:25 on dist-test-slave-gw5c"
server_key: "49e51704f38cee4a954592a8a4b3fb77"
server_key_iv: "04f7635a03076c278a79de190975cc5e"
server_key_version: "encryptionkey@0"
I20260812 06:13:25.244094 8769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "4459c95269dc4eccbbc52e14169ef47a"
format_stamp: "Formatted at 2026-08-12 06:13:25 on dist-test-slave-gw5c"
server_key: "49e51704f38cee4a954592a8a4b3fb77"
server_key_iv: "04f7635a03076c278a79de190975cc5e"
server_key_version: "encryptionkey@0"
I20260812 06:13:25.245680 8769 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:25.246589 8798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:25.246809 8769 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:25.246943 8769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "4459c95269dc4eccbbc52e14169ef47a"
format_stamp: "Formatted at 2026-08-12 06:13:25 on dist-test-slave-gw5c"
server_key: "49e51704f38cee4a954592a8a4b3fb77"
server_key_iv: "04f7635a03076c278a79de190975cc5e"
server_key_version: "encryptionkey@0"
I20260812 06:13:25.247041 8769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:25.250765 8769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:25.251037 8769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:25.251148 8769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:25.251310 8769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:25.251741 8769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:25.251798 8769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:25.251843 8769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:25.251871 8769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:25.258008 8769 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:45089
I20260812 06:13:25.258052 8997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:45089 every 8 connection(s)
I20260812 06:13:25.258453 8769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:13:25.262586 8291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.259376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:51887 (local address 127.0.176.254:43165)
0812 06:13:25.259887 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:25.259891 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:25.260209 (+ 318us) server_negotiation.cc:407] Connection header received
0812 06:13:25.260727 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:25.260728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:25.260738 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:25.260797 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:25.262266 (+ 1469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:25.262268 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:25.262269 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:25.262275 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:25.262294 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:25.262299 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:25.262377 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:25.262481 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 06:13:25.262501 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458}
I20260812 06:13:25.262811 9001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.259332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43165 (local address 127.0.176.195:51887)
0812 06:13:25.259926 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:25.259984 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:25.260586 (+ 602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:25.260877 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:25.260882 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:25.260902 (+ 20us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:25.262051 (+ 1149us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:13:25.262051 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:25.262085 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:13:25.262120 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:25.262376 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:25.262385 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:25.262388 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:25.262495 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 06:13:25.262570 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":390,"threads_started":1}
I20260812 06:13:25.263811 8998 heartbeater.cc:347] Connected to a master server at 127.0.176.254:43165
I20260812 06:13:25.263947 8998 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:25.264120 8998 heartbeater.cc:511] Master 127.0.176.254:43165 requested a full tablet report, sending...
I20260812 06:13:25.264743 8218 ts_manager.cc:194] Registered new tserver with Master: 4459c95269dc4eccbbc52e14169ef47a (127.0.176.195:45089)
I20260812 06:13:25.265488 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 8769
I20260812 06:13:25.265614 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:13:25.265810 707 external_mini_cluster.cc:1428] Setting key 63cf3d2ed9a6c460bf6fb8828e99d15d
I20260812 06:13:25.266816 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:13:25.270056 8291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.268638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40962 (local address 127.0.176.254:43165)
0812 06:13:25.268720 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:25.268722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:25.268897 (+ 175us) server_negotiation.cc:407] Connection header received
0812 06:13:25.268967 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:25.268967 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:25.268973 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:25.269024 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:25.269653 (+ 629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:25.269655 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:25.269655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:25.269659 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:25.269674 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:25.269678 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:25.269735 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:25.269911 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 06:13:25.269924 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 06:13:25.272125 8218 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40962:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:13:25.274367 8218 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:25.279852 9016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.277800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55526 (local address 127.0.176.194:37845)
0812 06:13:25.278065 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:25.278070 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:25.278082 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:13:25.278111 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:25.278113 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:25.278124 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:25.278233 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:25.279507 (+ 1274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:25.279516 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:25.279516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:25.279521 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:25.279560 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:25.279588 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:25.279676 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:25.279741 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 06:13:25.279757 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":121,"threads_started":1}
I20260812 06:13:25.279839 9015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.277775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:45089 (local address 127.0.0.1:52508)
0812 06:13:25.277864 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:25.277873 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:25.277928 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:25.278554 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:25.278555 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:25.278559 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:25.279290 (+ 731us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:13:25.279290 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:25.279308 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:13:25.279338 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:25.279629 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:25.279637 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:25.279640 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:25.279709 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:13:25.279724 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78,"thread_start_us":62,"threads_started":1}
I20260812 06:13:25.279894 9018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.278174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52508 (local address 127.0.176.195:45089)
0812 06:13:25.278367 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:25.278371 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:25.278383 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:13:25.278412 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:25.278415 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:25.278426 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:25.278793 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:25.279458 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:25.279465 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:25.279466 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:25.279470 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:25.279513 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:25.279547 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:25.279620 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:25.279791 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 06:13:25.279809 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":103,"threads_started":1}
I20260812 06:13:25.280081 9017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.277947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:45115 (local address 127.0.0.1:45888)
0812 06:13:25.278037 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:25.278047 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:25.278083 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:25.278943 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:25.278944 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:25.278947 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:25.279680 (+ 733us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:13:25.279681 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:25.279687 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:13:25.279699 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:25.279956 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:25.279957 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:25.279958 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:13:25.280006 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:13:25.280019 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81,"thread_start_us":62,"threads_started":1}
I20260812 06:13:25.280303 9020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.278291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45888 (local address 127.0.176.193:45115)
0812 06:13:25.278493 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:25.278498 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:25.278509 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:25.278535 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:25.278537 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:25.278546 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:25.278637 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:25.279787 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:25.279797 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:25.279797 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:25.279802 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:25.279840 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:25.279870 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:25.279928 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:25.280192 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 06:13:25.280210 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":113,"threads_started":1}
I20260812 06:13:25.280689 9014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.277695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:37845 (local address 127.0.0.1:55526)
0812 06:13:25.277820 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:25.277865 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:25.277928 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:25.278487 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:25.278496 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:25.278503 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:25.279352 (+ 849us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:13:25.279353 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:25.279361 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:13:25.279376 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:25.279668 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:25.279669 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:25.279670 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:13:25.279732 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 06:13:25.279747 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":71,"threads_started":1}
I20260812 06:13:25.281009 8884 tablet_service.cc:1467] Processing CreateTablet for tablet dd1b3a2c23c24cfcac4f686197937042 (DEFAULT_TABLE table=test-table [id=ed769c2482d34b0a96a2d57df81015fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:25.281127 8424 tablet_service.cc:1467] Processing CreateTablet for tablet dd1b3a2c23c24cfcac4f686197937042 (DEFAULT_TABLE table=test-table [id=ed769c2482d34b0a96a2d57df81015fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:25.281424 8424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd1b3a2c23c24cfcac4f686197937042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:25.281431 8884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd1b3a2c23c24cfcac4f686197937042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:25.281420 8634 tablet_service.cc:1467] Processing CreateTablet for tablet dd1b3a2c23c24cfcac4f686197937042 (DEFAULT_TABLE table=test-table [id=ed769c2482d34b0a96a2d57df81015fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:25.281764 8634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd1b3a2c23c24cfcac4f686197937042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:25.284663 9022 tablet_bootstrap.cc:492] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4: Bootstrap starting.
I20260812 06:13:25.285419 9025 tablet_bootstrap.cc:492] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7: Bootstrap starting.
I20260812 06:13:25.285661 9022 tablet_bootstrap.cc:654] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:25.286062 9022 log.cc:824] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:25.286402 9023 tablet_bootstrap.cc:492] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a: Bootstrap starting.
I20260812 06:13:25.287037 9022 tablet_bootstrap.cc:492] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4: No bootstrap required, opened a new log
I20260812 06:13:25.287117 9023 tablet_bootstrap.cc:654] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:25.287127 9022 ts_tablet_manager.cc:1397] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:13:25.286144 9025 tablet_bootstrap.cc:654] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:25.287498 9023 log.cc:824] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:25.287837 9025 log.cc:824] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:25.288451 9023 tablet_bootstrap.cc:492] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a: No bootstrap required, opened a new log
I20260812 06:13:25.288537 9023 ts_tablet_manager.cc:1397] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:13:25.288604 9025 tablet_bootstrap.cc:492] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7: No bootstrap required, opened a new log
I20260812 06:13:25.288679 9025 ts_tablet_manager.cc:1397] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:13:25.290009 9022 raft_consensus.cc:348] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4459c95269dc4eccbbc52e14169ef47a" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45089 } } peers { permanent_uuid: "fb1bee4f3f024b61b495e3d9af52f0a7" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37845 } } peers { permanent_uuid: "6a43d848969e45d68e68f56c072920f4" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45115 } }
I20260812 06:13:25.290207 9022 raft_consensus.cc:374] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:25.290244 9022 raft_consensus.cc:729] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a43d848969e45d68e68f56c072920f4, State: Initialized, Role: FOLLOWER
I20260812 06:13:25.290401 9022 consensus_queue.cc:260] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4459c95269dc4eccbbc52e14169ef47a" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45089 } } peers { permanent_uuid: "fb1bee4f3f024b61b495e3d9af52f0a7" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37845 } } peers { permanent_uuid: "6a43d848969e45d68e68f56c072920f4" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45115 } }
I20260812 06:13:25.290750 9022 ts_tablet_manager.cc:1428] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 06:13:25.290753 8538 heartbeater.cc:503] Master 127.0.176.254:43165 was elected leader, sending a full tablet report...
I20260812 06:13:25.291360 9023 raft_consensus.cc:348] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4459c95269dc4eccbbc52e14169ef47a" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45089 } } peers { permanent_uuid: "fb1bee4f3f024b61b495e3d9af52f0a7" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37845 } } peers { permanent_uuid: "6a43d848969e45d68e68f56c072920f4" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45115 } }
I20260812 06:13:25.291343 9025 raft_consensus.cc:348] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4459c95269dc4eccbbc52e14169ef47a" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45089 } } peers { permanent_uuid: "fb1bee4f3f024b61b495e3d9af52f0a7" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37845 } } peers { permanent_uuid: "6a43d848969e45d68e68f56c072920f4" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45115 } }
I20260812 06:13:25.291553 9023 raft_consensus.cc:374] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:25.291553 9025 raft_consensus.cc:374] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:25.291591 9023 raft_consensus.cc:729] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4459c95269dc4eccbbc52e14169ef47a, State: Initialized, Role: FOLLOWER
I20260812 06:13:25.291594 9025 raft_consensus.cc:729] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb1bee4f3f024b61b495e3d9af52f0a7, State: Initialized, Role: FOLLOWER
I20260812 06:13:25.291728 9025 consensus_queue.cc:260] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4459c95269dc4eccbbc52e14169ef47a" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45089 } } peers { permanent_uuid: "fb1bee4f3f024b61b495e3d9af52f0a7" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37845 } } peers { permanent_uuid: "6a43d848969e45d68e68f56c072920f4" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45115 } }
I20260812 06:13:25.291728 9023 consensus_queue.cc:260] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4459c95269dc4eccbbc52e14169ef47a" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45089 } } peers { permanent_uuid: "fb1bee4f3f024b61b495e3d9af52f0a7" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37845 } } peers { permanent_uuid: "6a43d848969e45d68e68f56c072920f4" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45115 } }
I20260812 06:13:25.292004 9025 ts_tablet_manager.cc:1428] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:13:25.292007 9023 ts_tablet_manager.cc:1428] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 06:13:25.292135 8998 heartbeater.cc:503] Master 127.0.176.254:43165 was elected leader, sending a full tablet report...
I20260812 06:13:25.292400 8764 heartbeater.cc:503] Master 127.0.176.254:43165 was elected leader, sending a full tablet report...
W20260812 06:13:25.368332 8767 tablet.cc:2369] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:13:25.423071 8539 tablet.cc:2369] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:13:25.509049 9000 tablet.cc:2369] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:13:25.593928 9035 raft_consensus.cc:482] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:25.594076 9035 raft_consensus.cc:504] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4459c95269dc4eccbbc52e14169ef47a" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45089 } } peers { permanent_uuid: "fb1bee4f3f024b61b495e3d9af52f0a7" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37845 } } peers { permanent_uuid: "6a43d848969e45d68e68f56c072920f4" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45115 } }
I20260812 06:13:25.594521 9035 leader_election.cc:288] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb1bee4f3f024b61b495e3d9af52f0a7 (127.0.176.194:37845), 6a43d848969e45d68e68f56c072920f4 (127.0.176.193:45115)
I20260812 06:13:25.596201 9001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.594787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:45115 (local address 127.0.176.195:56007)
0812 06:13:25.594850 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:25.594864 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:25.594907 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:25.595126 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:25.595127 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:25.595132 (+ 5us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:25.595771 (+ 639us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:13:25.595771 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:25.595779 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:13:25.595792 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:25.596048 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:25.596049 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:25.596050 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:13:25.596104 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:13:25.596125 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 06:13:25.596215 9020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.594874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:56007 (local address 127.0.176.193:45115)
0812 06:13:25.594940 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:25.594942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:25.594952 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:25.594985 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:25.594986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:25.594994 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:25.595099 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:25.595930 (+ 831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:25.595940 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:25.595940 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:25.595947 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:25.595967 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:25.595974 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:25.596036 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:25.596106 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 06:13:25.596123 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 06:13:25.596342 9037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.594786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:37845 (local address 127.0.176.195:43687)
0812 06:13:25.594991 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:25.595007 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:25.595049 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:25.595224 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:25.595225 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:25.595240 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:25.595983 (+ 743us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:13:25.595984 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:25.595988 (+ 4us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:13:25.595997 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:25.596201 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:25.596201 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:25.596202 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:13:25.596250 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:13:25.596262 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":15,"thread_start_us":128,"threads_started":1}
I20260812 06:13:25.596355 9016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.594874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:43687 (local address 127.0.176.194:37845)
0812 06:13:25.594927 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:25.594929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:25.595099 (+ 170us) server_negotiation.cc:407] Connection header received
0812 06:13:25.595131 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:25.595132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:25.595138 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:25.595205 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:25.596106 (+ 901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:25.596107 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:25.596108 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:25.596113 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:25.596130 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:25.596135 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:25.596193 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:25.596260 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 06:13:25.596274 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:13:25.596737 8690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd1b3a2c23c24cfcac4f686197937042" candidate_uuid: "4459c95269dc4eccbbc52e14169ef47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb1bee4f3f024b61b495e3d9af52f0a7" is_pre_election: true
I20260812 06:13:25.596762 8462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd1b3a2c23c24cfcac4f686197937042" candidate_uuid: "4459c95269dc4eccbbc52e14169ef47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a43d848969e45d68e68f56c072920f4" is_pre_election: true
I20260812 06:13:25.596920 8690 raft_consensus.cc:2454] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4459c95269dc4eccbbc52e14169ef47a in term 0.
I20260812 06:13:25.596961 8462 raft_consensus.cc:2454] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4459c95269dc4eccbbc52e14169ef47a in term 0.
I20260812 06:13:25.597158 8805 leader_election.cc:302] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4459c95269dc4eccbbc52e14169ef47a, fb1bee4f3f024b61b495e3d9af52f0a7; no voters:
I20260812 06:13:25.597350 9035 raft_consensus.cc:2781] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:25.597433 9035 raft_consensus.cc:482] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:25.597470 9035 raft_consensus.cc:3037] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:25.619215 9035 raft_consensus.cc:504] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4459c95269dc4eccbbc52e14169ef47a" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45089 } } peers { permanent_uuid: "fb1bee4f3f024b61b495e3d9af52f0a7" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37845 } } peers { permanent_uuid: "6a43d848969e45d68e68f56c072920f4" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45115 } }
I20260812 06:13:25.619637 9035 leader_election.cc:288] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [CANDIDATE]: Term 1 election: Requested vote from peers fb1bee4f3f024b61b495e3d9af52f0a7 (127.0.176.194:37845), 6a43d848969e45d68e68f56c072920f4 (127.0.176.193:45115)
I20260812 06:13:25.619827 8690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd1b3a2c23c24cfcac4f686197937042" candidate_uuid: "4459c95269dc4eccbbc52e14169ef47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb1bee4f3f024b61b495e3d9af52f0a7"
I20260812 06:13:25.619863 8462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd1b3a2c23c24cfcac4f686197937042" candidate_uuid: "4459c95269dc4eccbbc52e14169ef47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a43d848969e45d68e68f56c072920f4"
I20260812 06:13:25.619957 8462 raft_consensus.cc:3037] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:25.619958 8690 raft_consensus.cc:3037] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:25.621012 8690 raft_consensus.cc:2454] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4459c95269dc4eccbbc52e14169ef47a in term 1.
I20260812 06:13:25.621014 8462 raft_consensus.cc:2454] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4459c95269dc4eccbbc52e14169ef47a in term 1.
I20260812 06:13:25.621243 8805 leader_election.cc:302] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4459c95269dc4eccbbc52e14169ef47a, fb1bee4f3f024b61b495e3d9af52f0a7; no voters:
I20260812 06:13:25.621409 9035 raft_consensus.cc:2781] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:25.621610 9035 raft_consensus.cc:686] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [term 1 LEADER]: Becoming Leader. State: Replica: 4459c95269dc4eccbbc52e14169ef47a, State: Running, Role: LEADER
I20260812 06:13:25.621732 9035 consensus_queue.cc:237] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4459c95269dc4eccbbc52e14169ef47a" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45089 } } peers { permanent_uuid: "fb1bee4f3f024b61b495e3d9af52f0a7" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37845 } } peers { permanent_uuid: "6a43d848969e45d68e68f56c072920f4" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45115 } }
I20260812 06:13:25.623165 8215 catalog_manager.cc:5495] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4459c95269dc4eccbbc52e14169ef47a (127.0.176.195). New cstate: current_term: 1 leader_uuid: "4459c95269dc4eccbbc52e14169ef47a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4459c95269dc4eccbbc52e14169ef47a" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb1bee4f3f024b61b495e3d9af52f0a7" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a43d848969e45d68e68f56c072920f4" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45115 } health_report { overall_health: UNKNOWN } } }
I20260812 06:13:25.640664 9018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.638697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52520 (local address 127.0.176.195:45089)
0812 06:13:25.638774 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:25.638776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:25.638788 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:13:25.638833 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:25.638833 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:25.638848 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:25.638903 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:25.640277 (+ 1374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:25.640278 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:25.640279 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:25.640284 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:25.640305 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:25.640310 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:25.640388 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:25.640512 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 06:13:25.640526 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:13:25.643046 8462 raft_consensus.cc:1261] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4 [term 1 FOLLOWER]: Refusing update from remote peer 4459c95269dc4eccbbc52e14169ef47a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:25.643112 8690 raft_consensus.cc:1261] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7 [term 1 FOLLOWER]: Refusing update from remote peer 4459c95269dc4eccbbc52e14169ef47a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:25.643674 9040 consensus_queue.cc:1035] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a43d848969e45d68e68f56c072920f4" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:25.643846 9035 consensus_queue.cc:1035] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb1bee4f3f024b61b495e3d9af52f0a7" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:25.648401 9046 mvcc.cc:205] Tried to move back new op lower bound from 7317566282309562368 to 7317566282227961856. Current Snapshot: MvccSnapshot[applied={T|T < 7317566282309562368}]
I20260812 06:13:25.648418 9054 mvcc.cc:205] Tried to move back new op lower bound from 7317566282309562368 to 7317566282227961856. Current Snapshot: MvccSnapshot[applied={T|T < 7317566282309562368}]
I20260812 06:13:25.651098 8215 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:25.651223 8215 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:25.652241 8215 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 588fe3cab22a46f09d61806de156e334: Sending DeleteTablet for 3 replicas of tablet dd1b3a2c23c24cfcac4f686197937042
I20260812 06:13:25.652613 8634 tablet_service.cc:1514] Processing DeleteTablet for tablet dd1b3a2c23c24cfcac4f686197937042 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:25 UTC) from {username='slave'} at 127.0.0.1:55526
I20260812 06:13:25.652680 8424 tablet_service.cc:1514] Processing DeleteTablet for tablet dd1b3a2c23c24cfcac4f686197937042 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:25 UTC) from {username='slave'} at 127.0.0.1:45888
I20260812 06:13:25.652951 9064 tablet_replica.cc:330] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4: stopping tablet replica
I20260812 06:13:25.653026 8884 tablet_service.cc:1514] Processing DeleteTablet for tablet dd1b3a2c23c24cfcac4f686197937042 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:25 UTC) from {username='slave'} at 127.0.0.1:52508
I20260812 06:13:25.653041 9063 tablet_replica.cc:330] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7: stopping tablet replica
I20260812 06:13:25.653076 9064 raft_consensus.cc:2229] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:25.653154 9063 raft_consensus.cc:2229] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:25.653208 9064 raft_consensus.cc:2258] T dd1b3a2c23c24cfcac4f686197937042 P 6a43d848969e45d68e68f56c072920f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:25.653256 9063 raft_consensus.cc:2258] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:25.653425 9067 tablet_replica.cc:330] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a: stopping tablet replica
I20260812 06:13:25.653519 9067 raft_consensus.cc:2229] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:13:25.653594 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 8325
I20260812 06:13:25.653641 9067 raft_consensus.cc:2258] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:25.662815 9063 ts_tablet_manager.cc:1905] T dd1b3a2c23c24cfcac4f686197937042 P fb1bee4f3f024b61b495e3d9af52f0a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:25.662819 9067 ts_tablet_manager.cc:1905] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 06:13:25.669962 8191 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:45115 (error 108)
I20260812 06:13:25.670311 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 8541
I20260812 06:13:25.678023 9014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.670431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:45115 (local address 127.0.0.1:45904)
0812 06:13:25.677876 (+ 7445us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:25.677974 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:45115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7403}
W20260812 06:13:25.680977 8191 catalog_manager.cc:4584] TS 6a43d848969e45d68e68f56c072920f4 (127.0.176.193:45115): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dd1b3a2c23c24cfcac4f686197937042: Network error: Client connection negotiation failed: client connection to 127.0.176.193:45115: connect: Connection refused (error 111)
I20260812 06:13:25.724413 9067 ts_tablet_manager.cc:1918] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:25.724543 9067 log.cc:1196] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/dd1b3a2c23c24cfcac4f686197937042
I20260812 06:13:25.724821 9067 ts_tablet_manager.cc:1939] T dd1b3a2c23c24cfcac4f686197937042 P 4459c95269dc4eccbbc52e14169ef47a: Deleting consensus metadata
I20260812 06:13:25.726758 9014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.726601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:37845 (local address 127.0.0.1:55530)
0812 06:13:25.726670 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:25.726706 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.194:37845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 06:13:25.727049 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 8769
I20260812 06:13:25.734031 9014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.733877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:45115 (local address 127.0.0.1:45912)
0812 06:13:25.733937 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:25.733967 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:45115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 06:13:25.734469 9014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.734377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:45115 (local address 127.0.0.1:45928)
0812 06:13:25.734413 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:25.734437 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:45115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260812 06:13:25.746860 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 8167
I20260812 06:13:25.747022 9014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.746814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:45089 (local address 127.0.0.1:52526)
0812 06:13:25.746917 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:25.746964 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.195:45089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
2026-08-12T06:13:25Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1145 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 06:13:25.780515 707 mini_oidc.cc:152] Starting JWKS server
I20260812 06:13:25.781903 707 webserver.cc:460] Webserver started at https://127.0.0.1:39549/ using document root <none> and password file <none>
I20260812 06:13:25.782017 707 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 06:13:25.782243 707 webserver.cc:460] Webserver started at http://127.0.0.1:40383/ using document root <none> and password file <none>
2026-08-12T06:13:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:25Z Disabled control of system clock
I20260812 06:13:25.792632 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42217
--webserver_interface=127.0.176.254
--webserver_port=0
--builtin_ntp_servers=127.0.176.212:46057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:42217
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39549/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/testchainca.cert with env {}
W20260812 06:13:25.892284 9085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:25.892583 9085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:25.892632 9085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:25.893968 9085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:25.894053 9085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:25.894076 9085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:25.894098 9085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:25.894129 9085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:13:25.894155 9085 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:13:25.894182 9085 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39549/jwks.json
I20260812 06:13:25.896049 9085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:46057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:42217
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39549/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:25.896413 9085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:25.896807 9085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:25.902946 9094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:25.903142 9095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:25.903014 9099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:25.903216 9085 server_base.cc:1034] running on GCE node
I20260812 06:13:25.903524 9085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:25.903905 9085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:25.905119 9085 hybrid_clock.cc:648] HybridClock initialized: now 1786515205905100 us; error 47 us; skew 500 ppm
I20260812 06:13:25.906635 9085 webserver.cc:460] Webserver started at http://127.0.176.254:41879/ using document root <none> and password file <none>
I20260812 06:13:25.906929 9085 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:25.907009 9085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:25.907174 9085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:25.908535 9085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "4c2e349c2e0e43acb2eb6b87c43e9763"
format_stamp: "Formatted at 2026-08-12 06:13:25 on dist-test-slave-gw5c"
server_key: "1c9363069f412d4a8b307fc118b106e1"
server_key_iv: "827a9c617d412716455d8325080704cc"
server_key_version: "encryptionkey@0"
I20260812 06:13:25.908963 9085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "4c2e349c2e0e43acb2eb6b87c43e9763"
format_stamp: "Formatted at 2026-08-12 06:13:25 on dist-test-slave-gw5c"
server_key: "1c9363069f412d4a8b307fc118b106e1"
server_key_iv: "827a9c617d412716455d8325080704cc"
server_key_version: "encryptionkey@0"
I20260812 06:13:25.910465 9085 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:25.911341 9108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:25.911567 9085 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:25.911722 9085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "4c2e349c2e0e43acb2eb6b87c43e9763"
format_stamp: "Formatted at 2026-08-12 06:13:25 on dist-test-slave-gw5c"
server_key: "1c9363069f412d4a8b307fc118b106e1"
server_key_iv: "827a9c617d412716455d8325080704cc"
server_key_version: "encryptionkey@0"
I20260812 06:13:25.911813 9085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:25.918599 9085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:25.918932 9085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:25.919104 9085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:25.923374 9085 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:42217
I20260812 06:13:25.923491 9199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:42217 every 8 connection(s)
I20260812 06:13:25.923872 9085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:25.925135 9200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:25.928294 9200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763: Bootstrap starting.
I20260812 06:13:25.928838 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 9085
I20260812 06:13:25.928969 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:25.929141 9200 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:25.929191 707 external_mini_cluster.cc:1428] Setting key 36b9492cb56b0760a11a55eb329b2ccb
I20260812 06:13:25.929587 9200 log.cc:824] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:25.930495 9200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763: No bootstrap required, opened a new log
I20260812 06:13:25.932778 9200 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c2e349c2e0e43acb2eb6b87c43e9763" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42217 } }
I20260812 06:13:25.933001 9200 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:25.933059 9200 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c2e349c2e0e43acb2eb6b87c43e9763, State: Initialized, Role: FOLLOWER
I20260812 06:13:25.933218 9200 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c2e349c2e0e43acb2eb6b87c43e9763" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42217 } }
I20260812 06:13:25.933307 9200 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:25.933341 9200 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:25.933389 9200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:25.934208 9200 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c2e349c2e0e43acb2eb6b87c43e9763" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42217 } }
I20260812 06:13:25.934340 9200 leader_election.cc:302] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c2e349c2e0e43acb2eb6b87c43e9763; no voters:
I20260812 06:13:25.934535 9200 leader_election.cc:288] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:25.934726 9210 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:25.934866 9200 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:25.934970 9210 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [term 1 LEADER]: Becoming Leader. State: Replica: 4c2e349c2e0e43acb2eb6b87c43e9763, State: Running, Role: LEADER
I20260812 06:13:25.935127 9210 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c2e349c2e0e43acb2eb6b87c43e9763" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42217 } }
I20260812 06:13:25.935559 9210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c2e349c2e0e43acb2eb6b87c43e9763" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c2e349c2e0e43acb2eb6b87c43e9763" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42217 } } }
I20260812 06:13:25.935719 9210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:25.935714 9208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c2e349c2e0e43acb2eb6b87c43e9763. Latest consensus state: current_term: 1 leader_uuid: "4c2e349c2e0e43acb2eb6b87c43e9763" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c2e349c2e0e43acb2eb6b87c43e9763" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42217 } } }
I20260812 06:13:25.935899 9208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:25.936151 9224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:25.936718 9224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:25.937345 9207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.929811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58348 (local address 127.0.176.254:42217)
0812 06:13:25.930085 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:25.930095 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:25.930128 (+ 33us) server_negotiation.cc:407] Connection header received
0812 06:13:25.930845 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:25.930854 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:25.930946 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:25.931098 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:25.931370 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:25.932836 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:25.934393 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:25.935041 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:25.935181 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:25.936374 (+ 1193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:25.936379 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:25.936379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:25.936616 (+ 237us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:25.936669 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:25.936687 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:25.936759 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:25.937012 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 06:13:25.937100 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":118,"threads_started":1}
I20260812 06:13:25.938433 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:13:25.940037 9224 catalog_manager.cc:1347] Generated new cluster ID: 0fba58c364e74247b569c3ffefddb668
I20260812 06:13:25.940097 9224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:25.948736 9224 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:25.949329 9224 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:25.962906 9224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c2e349c2e0e43acb2eb6b87c43e9763: Generated new TSK 0
I20260812 06:13:25.963150 9224 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 06:13:25.989161 9257 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 06:13:25.989365 9257 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 06:13:25.989591 9207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:25.973061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58356 (local address 127.0.176.254:42217)
0812 06:13:25.973136 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:25.973138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:25.973328 (+ 190us) server_negotiation.cc:407] Connection header received
0812 06:13:25.973444 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:25.973445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:25.973455 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:25.973514 (+ 59us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:13:25.973774 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:25.974293 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:25.975793 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:25.976007 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:25.976064 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:25.976300 (+ 236us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:13:25.989300 (+ 13000us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39549/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 06:13:25.989519 (+ 219us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58356: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39549/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":45}
W20260812 06:13:25.989691 9207 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58356: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39549/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 06:13:25.990303 9254 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:25.972979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42217 (local address 127.0.0.1:58356)
0812 06:13:25.973242 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:25.973256 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:25.973342 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:25.973546 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:25.973546 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:25.973553 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:13:25.973649 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:25.973653 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:25.974375 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:25.974376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:25.975700 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:25.975704 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:25.976091 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:25.976092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:25.976161 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:25.976186 (+ 25us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:13:25.989592 (+ 13406us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39549/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 06:13:25.989854 (+ 262us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.0.176.254:42217: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39549/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":114,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.0.176.254:42217: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39549/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 06:13:25.990815 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 9085
2026-08-12T06:13:26Z chronyd exiting
I20260812 06:13:26.055672 707 test_util.cc:175] -----------------------------------------------
I20260812 06:13:26.055780 707 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515178947866-707-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (276 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 06:13:26.056613 707 mini_oidc.cc:152] Starting JWKS server
I20260812 06:13:26.057345 707 webserver.cc:460] Webserver started at https://127.0.0.1:36003/ using document root <none> and password file <none>
I20260812 06:13:26.057415 707 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 06:13:26.057598 707 webserver.cc:460] Webserver started at http://127.0.0.1:35283/ using document root <none> and password file <none>
2026-08-12T06:13:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:26Z Disabled control of system clock
I20260812 06:13:26.066807 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:37929
--webserver_interface=127.0.176.254
--webserver_port=0
--builtin_ntp_servers=127.0.176.212:43141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:37929
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36003/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/testchainca.cert with env {}
W20260812 06:13:26.155862 9263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:26.156149 9263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:26.156194 9263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:26.157444 9263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:26.157518 9263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:26.157541 9263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:26.157564 9263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:26.157593 9263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:13:26.157619 9263 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:13:26.157649 9263 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36003/jwks.json
I20260812 06:13:26.159245 9263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:43141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:37929
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:37929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36003/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:26.159575 9263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:26.159830 9263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:26.164712 9276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:26.164733 9269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:26.164733 9271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:26.165100 9263 server_base.cc:1034] running on GCE node
I20260812 06:13:26.165357 9263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:26.165618 9263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:26.166790 9263 hybrid_clock.cc:648] HybridClock initialized: now 1786515206166757 us; error 41 us; skew 500 ppm
I20260812 06:13:26.168036 9263 webserver.cc:460] Webserver started at http://127.0.176.254:36161/ using document root <none> and password file <none>
I20260812 06:13:26.168294 9263 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:26.168362 9263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:26.168460 9263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:26.169508 9263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "0beb83866c3d4fc1a886f835f5591859"
format_stamp: "Formatted at 2026-08-12 06:13:26 on dist-test-slave-gw5c"
server_key: "d208881dbad598c27846f7de037e093b"
server_key_iv: "8be2eff98bc49bb6d5549497d8ae142e"
server_key_version: "encryptionkey@0"
I20260812 06:13:26.169817 9263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "0beb83866c3d4fc1a886f835f5591859"
format_stamp: "Formatted at 2026-08-12 06:13:26 on dist-test-slave-gw5c"
server_key: "d208881dbad598c27846f7de037e093b"
server_key_iv: "8be2eff98bc49bb6d5549497d8ae142e"
server_key_version: "encryptionkey@0"
I20260812 06:13:26.171116 9263 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:26.171989 9284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:26.172222 9263 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:13:26.172313 9263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "0beb83866c3d4fc1a886f835f5591859"
format_stamp: "Formatted at 2026-08-12 06:13:26 on dist-test-slave-gw5c"
server_key: "d208881dbad598c27846f7de037e093b"
server_key_iv: "8be2eff98bc49bb6d5549497d8ae142e"
server_key_version: "encryptionkey@0"
I20260812 06:13:26.172374 9263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:26.200906 9263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:26.201231 9263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:26.201351 9263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:26.205677 9263 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:37929
I20260812 06:13:26.205768 9392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:37929 every 8 connection(s)
I20260812 06:13:26.206149 9263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:26.207175 9394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:26.209605 9394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859: Bootstrap starting.
I20260812 06:13:26.210261 9394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:26.210583 9394 log.cc:824] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:26.211339 9394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859: No bootstrap required, opened a new log
I20260812 06:13:26.211982 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 9263
I20260812 06:13:26.212070 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:26.212296 707 external_mini_cluster.cc:1428] Setting key f822a23790ffb2e8526cddf429542311
I20260812 06:13:26.213459 9394 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0beb83866c3d4fc1a886f835f5591859" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37929 } }
I20260812 06:13:26.213644 9394 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:26.213693 9394 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0beb83866c3d4fc1a886f835f5591859, State: Initialized, Role: FOLLOWER
I20260812 06:13:26.213822 9394 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0beb83866c3d4fc1a886f835f5591859" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37929 } }
I20260812 06:13:26.213930 9394 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:26.213970 9394 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:26.214017 9394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:26.218612 9399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:26.212842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32882 (local address 127.0.176.254:37929)
0812 06:13:26.213056 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:26.213064 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:26.213089 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:13:26.213438 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:26.213444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:26.213501 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:26.213615 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:26.214085 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.215288 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.216130 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.216593 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.216688 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:26.217858 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:26.217862 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:26.217862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:26.218045 (+ 183us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:26.218084 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:26.218095 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:26.218160 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:26.218279 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 06:13:26.218398 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":99,"threads_started":1}
I20260812 06:13:26.219856 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:13:26.234113 9394 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0beb83866c3d4fc1a886f835f5591859" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37929 } }
I20260812 06:13:26.234334 9394 leader_election.cc:302] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0beb83866c3d4fc1a886f835f5591859; no voters:
I20260812 06:13:26.234694 9400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:26.234695 9394 leader_election.cc:288] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:26.234910 9400 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [term 1 LEADER]: Becoming Leader. State: Replica: 0beb83866c3d4fc1a886f835f5591859, State: Running, Role: LEADER
I20260812 06:13:26.235050 9400 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0beb83866c3d4fc1a886f835f5591859" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37929 } }
I20260812 06:13:26.235121 9394 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:26.235513 9402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0beb83866c3d4fc1a886f835f5591859. Latest consensus state: current_term: 1 leader_uuid: "0beb83866c3d4fc1a886f835f5591859" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0beb83866c3d4fc1a886f835f5591859" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37929 } } }
I20260812 06:13:26.235596 9402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:26.235822 9401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0beb83866c3d4fc1a886f835f5591859" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0beb83866c3d4fc1a886f835f5591859" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37929 } } }
I20260812 06:13:26.235954 9401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:26.236469 9408 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:26.237037 9408 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:26.238775 9408 catalog_manager.cc:1347] Generated new cluster ID: 56811b07216d4bfb896b1e759f9fb695
I20260812 06:13:26.238830 9408 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:26.252328 9408 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:26.253119 9408 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:26.258265 9408 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0beb83866c3d4fc1a886f835f5591859: Generated new TSK 0
I20260812 06:13:26.258478 9408 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 06:13:26.282593 9444 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 06:13:26.282703 9444 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 06:13:26.283113 9399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:26.267603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32888 (local address 127.0.176.254:37929)
0812 06:13:26.267672 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:26.267674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:26.267684 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:26.267728 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:26.267729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:26.267739 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:26.267803 (+ 64us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:13:26.268009 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.268534 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.269663 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.269841 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.269894 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:26.270087 (+ 193us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:13:26.282920 (+ 12833us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36003/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 06:13:26.283057 (+ 137us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:32888: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36003/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":44}
W20260812 06:13:26.283193 9399 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:32888: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36003/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 06:13:26.283320 9442 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:26.267338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:37929 (local address 127.0.0.1:32888)
0812 06:13:26.267524 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:26.267537 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:26.267603 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:26.267818 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:26.267819 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:26.267821 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:13:26.267888 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:26.267891 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.268623 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.268624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:26.269577 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:26.269579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.269915 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.269916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:26.269979 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:26.269985 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:13:26.283058 (+ 13073us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36003/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 06:13:26.283199 (+ 141us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.0.176.254:37929: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36003/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":111,"threads_started":1}
I20260812 06:13:26.283722 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 9263
2026-08-12T06:13:26Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (268 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 06:13:26.325641 707 mini_oidc.cc:152] Starting JWKS server
I20260812 06:13:26.326368 707 webserver.cc:460] Webserver started at https://127.0.0.1:37119/ using document root <none> and password file <none>
I20260812 06:13:26.326442 707 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 06:13:26.326632 707 webserver.cc:460] Webserver started at http://127.0.0.1:45937/ using document root <none> and password file <none>
2026-08-12T06:13:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:26Z Disabled control of system clock
I20260812 06:13:26.336169 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:36431
--webserver_interface=127.0.176.254
--webserver_port=0
--builtin_ntp_servers=127.0.176.212:46315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:36431
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37119/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 06:13:26.423543 9456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:26.423758 9456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:26.423780 9456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:26.425010 9456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:26.425055 9456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:26.425068 9456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:26.425082 9456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:26.425140 9456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:13:26.425166 9456 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:13:26.425189 9456 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37119/jwks.json
I20260812 06:13:26.426952 9456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:46315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:36431
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:36431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37119/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:26.427246 9456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:26.427620 9456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:26.432587 9469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:26.432605 9464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:26.432606 9466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:26.432859 9456 server_base.cc:1034] running on GCE node
I20260812 06:13:26.433116 9456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:26.433465 9456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:26.434648 9456 hybrid_clock.cc:648] HybridClock initialized: now 1786515206434626 us; error 41 us; skew 500 ppm
I20260812 06:13:26.436018 9456 webserver.cc:460] Webserver started at http://127.0.176.254:38225/ using document root <none> and password file <none>
I20260812 06:13:26.436295 9456 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:26.436376 9456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:26.436538 9456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:26.437671 9456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "65f708b7a2ec4fd6b58ff76c775a491b"
format_stamp: "Formatted at 2026-08-12 06:13:26 on dist-test-slave-gw5c"
server_key: "04473c71fa94d1a48efd3b0dbcf1f96d"
server_key_iv: "a0c6b774c6c2019732f58f1c8b3db708"
server_key_version: "encryptionkey@0"
I20260812 06:13:26.438056 9456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "65f708b7a2ec4fd6b58ff76c775a491b"
format_stamp: "Formatted at 2026-08-12 06:13:26 on dist-test-slave-gw5c"
server_key: "04473c71fa94d1a48efd3b0dbcf1f96d"
server_key_iv: "a0c6b774c6c2019732f58f1c8b3db708"
server_key_version: "encryptionkey@0"
I20260812 06:13:26.439487 9456 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:13:26.440248 9481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:26.440439 9456 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:13:26.440549 9456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "65f708b7a2ec4fd6b58ff76c775a491b"
format_stamp: "Formatted at 2026-08-12 06:13:26 on dist-test-slave-gw5c"
server_key: "04473c71fa94d1a48efd3b0dbcf1f96d"
server_key_iv: "a0c6b774c6c2019732f58f1c8b3db708"
server_key_version: "encryptionkey@0"
I20260812 06:13:26.440626 9456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:26.457064 9456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:26.457523 9456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:26.457719 9456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:26.462466 9456 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:36431
I20260812 06:13:26.462518 9581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:36431 every 8 connection(s)
I20260812 06:13:26.463063 9456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:26.463932 9582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:26.467243 9582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b: Bootstrap starting.
I20260812 06:13:26.467994 9582 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:26.468307 9582 log.cc:824] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:26.469195 9582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b: No bootstrap required, opened a new log
I20260812 06:13:26.470954 9582 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f708b7a2ec4fd6b58ff76c775a491b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36431 } }
I20260812 06:13:26.471117 9582 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:26.471140 9582 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f708b7a2ec4fd6b58ff76c775a491b, State: Initialized, Role: FOLLOWER
I20260812 06:13:26.471308 9582 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f708b7a2ec4fd6b58ff76c775a491b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36431 } }
I20260812 06:13:26.471462 9582 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:26.471505 9582 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:26.471539 9582 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:26.471630 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 9456
I20260812 06:13:26.471724 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:26.471858 707 external_mini_cluster.cc:1428] Setting key 2e6d165bd0befb8ea4d7112796dbd347
I20260812 06:13:26.477492 9587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:26.472410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40798 (local address 127.0.176.254:36431)
0812 06:13:26.472767 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:26.472776 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:26.472809 (+ 33us) server_negotiation.cc:407] Connection header received
0812 06:13:26.472914 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:26.472919 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:26.472978 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:26.473106 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:26.473297 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.474520 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.475277 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.475777 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.475874 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:26.476518 (+ 644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:26.476523 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:26.476523 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:26.476718 (+ 195us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:26.476752 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:26.476764 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:26.476824 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:26.477212 (+ 388us) server_negotiation.cc:299] Negotiation successful
0812 06:13:26.477299 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":140,"threads_started":1}
I20260812 06:13:26.478582 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:13:26.546003 9582 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f708b7a2ec4fd6b58ff76c775a491b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36431 } }
I20260812 06:13:26.546175 9582 leader_election.cc:302] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65f708b7a2ec4fd6b58ff76c775a491b; no voters:
I20260812 06:13:26.546445 9582 leader_election.cc:288] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:26.546536 9589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:26.546720 9589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [term 1 LEADER]: Becoming Leader. State: Replica: 65f708b7a2ec4fd6b58ff76c775a491b, State: Running, Role: LEADER
I20260812 06:13:26.546765 9582 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:26.546836 9589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f708b7a2ec4fd6b58ff76c775a491b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36431 } }
I20260812 06:13:26.547327 9592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65f708b7a2ec4fd6b58ff76c775a491b. Latest consensus state: current_term: 1 leader_uuid: "65f708b7a2ec4fd6b58ff76c775a491b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f708b7a2ec4fd6b58ff76c775a491b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36431 } } }
I20260812 06:13:26.547364 9590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65f708b7a2ec4fd6b58ff76c775a491b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f708b7a2ec4fd6b58ff76c775a491b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36431 } } }
I20260812 06:13:26.547560 9590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:26.547765 9592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:26.547917 9607 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:26.548481 9607 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:26.551491 9607 catalog_manager.cc:1347] Generated new cluster ID: 254f2b69b8fa4fcbbd2bce5437f906a4
I20260812 06:13:26.551558 9607 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:26.576963 9607 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:26.577514 9607 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:26.586933 9607 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65f708b7a2ec4fd6b58ff76c775a491b: Generated new TSK 0
I20260812 06:13:26.587165 9607 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:13:26.597591 9587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:26.593517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40806 (local address 127.0.176.254:36431)
0812 06:13:26.593568 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:26.593571 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:26.593630 (+ 59us) server_negotiation.cc:407] Connection header received
0812 06:13:26.593743 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:26.593744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:26.593755 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:26.593816 (+ 61us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:13:26.593976 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.594466 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.595704 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.595898 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.595969 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:26.596161 (+ 192us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:13:26.597192 (+ 1031us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37119/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 06:13:26.597331 (+ 139us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40806: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37119/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 06:13:26.597695 9587 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40806: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37119/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 06:13:26.598059 9639 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:26.593384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36431 (local address 127.0.0.1:40806)
0812 06:13:26.593566 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:26.593578 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:26.593650 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:26.593835 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:26.593837 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:26.593839 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:13:26.593902 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:26.593906 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.594550 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.594551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:26.595604 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:26.595608 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.595989 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.595991 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:26.596053 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:26.596059 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:13:26.597306 (+ 1247us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37119/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 06:13:26.597600 (+ 294us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.0.176.254:36431: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37119/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":104,"threads_started":1}
I20260812 06:13:26.598340 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 9456
E20260812 06:13:26.620838 9642 webserver.cc:533] Webserver: sslize failed:
E20260812 06:13:26.620959 9642 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T06:13:26Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (326 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T06:13:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:26Z Disabled control of system clock
I20260812 06:13:26.661514 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:39351
--webserver_interface=127.0.176.254
--webserver_port=0
--builtin_ntp_servers=127.0.176.212:32929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:39351
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/testchainca.cert with env {}
W20260812 06:13:26.746335 9655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:26.746557 9655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:26.746580 9655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:26.747833 9655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:26.747882 9655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:26.747896 9655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:26.747910 9655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:26.747921 9655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:13:26.747934 9655 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:13:26.747946 9655 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 06:13:26.749439 9655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:32929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:39351
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:39351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:26.749660 9655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:26.749869 9655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:26.755064 9661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:26.755117 9664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:26.755084 9662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:26.755373 9655 server_base.cc:1034] running on GCE node
I20260812 06:13:26.755707 9655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:26.756043 9655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:26.757225 9655 hybrid_clock.cc:648] HybridClock initialized: now 1786515206757204 us; error 52 us; skew 500 ppm
I20260812 06:13:26.758915 9655 webserver.cc:460] Webserver started at http://127.0.176.254:34259/ using document root <none> and password file <none>
I20260812 06:13:26.759356 9655 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:26.759478 9655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:26.759683 9655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:26.760876 9655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "99ecc6e8cc284d02bd2f5d36a1a6553d"
format_stamp: "Formatted at 2026-08-12 06:13:26 on dist-test-slave-gw5c"
server_key: "4a0fc5b62dd3b2aaa3076a40f96d0748"
server_key_iv: "82d489e8262d3465b8ddd0852a0a3e48"
server_key_version: "encryptionkey@0"
I20260812 06:13:26.761269 9655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "99ecc6e8cc284d02bd2f5d36a1a6553d"
format_stamp: "Formatted at 2026-08-12 06:13:26 on dist-test-slave-gw5c"
server_key: "4a0fc5b62dd3b2aaa3076a40f96d0748"
server_key_iv: "82d489e8262d3465b8ddd0852a0a3e48"
server_key_version: "encryptionkey@0"
I20260812 06:13:26.762650 9655 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:13:26.763535 9674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:26.763734 9655 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:26.763832 9655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "99ecc6e8cc284d02bd2f5d36a1a6553d"
format_stamp: "Formatted at 2026-08-12 06:13:26 on dist-test-slave-gw5c"
server_key: "4a0fc5b62dd3b2aaa3076a40f96d0748"
server_key_iv: "82d489e8262d3465b8ddd0852a0a3e48"
server_key_version: "encryptionkey@0"
I20260812 06:13:26.763901 9655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:26.776822 9655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:26.777127 9655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:26.777237 9655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:26.781353 9655 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:39351
I20260812 06:13:26.781447 9774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:39351 every 8 connection(s)
I20260812 06:13:26.781775 9655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:26.782799 9776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:26.785375 9776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d: Bootstrap starting.
I20260812 06:13:26.786002 9776 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:26.786319 9776 log.cc:824] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:26.787025 9776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d: No bootstrap required, opened a new log
I20260812 06:13:26.787340 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 9655
I20260812 06:13:26.787604 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:26.787811 707 external_mini_cluster.cc:1428] Setting key 6025ef9c07f99880892d406ad3472d62
I20260812 06:13:26.789499 9776 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ecc6e8cc284d02bd2f5d36a1a6553d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39351 } }
I20260812 06:13:26.789692 9776 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:26.789752 9776 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ecc6e8cc284d02bd2f5d36a1a6553d, State: Initialized, Role: FOLLOWER
I20260812 06:13:26.789882 9776 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ecc6e8cc284d02bd2f5d36a1a6553d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39351 } }
I20260812 06:13:26.789971 9776 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:26.790004 9776 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:26.790058 9776 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:26.790922 9776 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ecc6e8cc284d02bd2f5d36a1a6553d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39351 } }
I20260812 06:13:26.791035 9776 leader_election.cc:302] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99ecc6e8cc284d02bd2f5d36a1a6553d; no voters:
I20260812 06:13:26.791213 9776 leader_election.cc:288] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:26.791281 9784 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:26.791464 9784 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [term 1 LEADER]: Becoming Leader. State: Replica: 99ecc6e8cc284d02bd2f5d36a1a6553d, State: Running, Role: LEADER
I20260812 06:13:26.791498 9776 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:26.791558 9784 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ecc6e8cc284d02bd2f5d36a1a6553d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39351 } }
I20260812 06:13:26.791873 9784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99ecc6e8cc284d02bd2f5d36a1a6553d. Latest consensus state: current_term: 1 leader_uuid: "99ecc6e8cc284d02bd2f5d36a1a6553d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ecc6e8cc284d02bd2f5d36a1a6553d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39351 } } }
I20260812 06:13:26.791998 9784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:26.791893 9787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99ecc6e8cc284d02bd2f5d36a1a6553d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ecc6e8cc284d02bd2f5d36a1a6553d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39351 } } }
I20260812 06:13:26.792089 9787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d [sys.catalog]: This master's current role is: LEADER
W20260812 06:13:26.793322 9810 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:13:26.793396 9810 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:13:26.793453 9795 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:26.793627 9795 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:26.795441 9795 catalog_manager.cc:1347] Generated new cluster ID: 9284ce360be742618a7651ded9543323
I20260812 06:13:26.795495 9795 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:26.804070 9781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:26.788363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55028 (local address 127.0.176.254:39351)
0812 06:13:26.788603 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:26.788612 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:26.788649 (+ 37us) server_negotiation.cc:407] Connection header received
0812 06:13:26.789454 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:26.789464 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:26.789549 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:26.789719 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:26.789961 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.791808 (+ 1847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.793092 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.793700 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.793817 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:26.794853 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:26.794857 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:26.794858 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:26.795071 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:26.795113 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:26.795128 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:26.803545 (+ 8417us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:26.803593 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 06:13:26.803827 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":87,"threads_started":1}
I20260812 06:13:26.804236 9795 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:26.804968 9795 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:26.805253 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:13:26.824572 9795 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99ecc6e8cc284d02bd2f5d36a1a6553d: Generated new TSK 0
I20260812 06:13:26.824826 9795 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:13:27.278990 9781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:26.836626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55038 (local address 127.0.176.254:39351)
0812 06:13:26.836695 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:26.836697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:26.836780 (+ 83us) server_negotiation.cc:407] Connection header received
0812 06:13:26.836887 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:26.836888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:26.836901 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:26.836986 (+ 85us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:13:26.837147 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.837632 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.838441 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.838647 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.838724 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:26.838923 (+ 199us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:13:27.278736 (+439813us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 06:13:27.278916 (+ 180us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55038: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":43}
W20260812 06:13:27.279060 9781 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55038: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 06:13:27.279218 9821 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:26.836535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:39351 (local address 127.0.0.1:55038)
0812 06:13:26.836701 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:26.836713 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:26.836800 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:26.836998 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:26.836999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:26.837001 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:13:26.837067 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:26.837069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.837738 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.837739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:26.838341 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:26.838343 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:26.838735 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:26.838736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:26.838797 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:26.838802 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:13:27.278906 (+440104us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 06:13:27.279082 (+ 176us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.0.176.254:39351: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":98,"threads_started":1}
I20260812 06:13:27.279645 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 9655
2026-08-12T06:13:27Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (659 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (104 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (103 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:13:27 dist-test-slave-gw5c krb5kdc[9837](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:13:27 dist-test-slave-gw5c krb5kdc[9837](info): set up 2 sockets
Aug 12 06:13:27 dist-test-slave-gw5c krb5kdc[9837](info): commencing operation
krb5kdc: starting...
W20260812 06:13:28.809165 707 mini_kdc.cc:121] Time spent starting KDC: real 1.290s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:28 dist-test-slave-gw5c krb5kdc[9837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:13:28.941968 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:41191
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:35419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:41191
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:29.032318 9862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:29.032557 9862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:29.032581 9862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:29.033821 9862 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:29.033870 9862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:29.033885 9862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:29.033897 9862 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:29.033910 9862 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:29.035642 9862 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:35419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:41191
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:41191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:29.035933 9862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:29.036188 9862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:29.041500 9870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:29.041517 9874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:29.041798 9862 server_base.cc:1034] running on GCE node
W20260812 06:13:29.041500 9871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:29.042109 9862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:29.042462 9862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:29.043608 9862 hybrid_clock.cc:648] HybridClock initialized: now 1786515209043598 us; error 36 us; skew 500 ppm
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:29.055757 9862 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:13:29.056309 9862 webserver.cc:460] Webserver started at http://127.0.176.254:35707/ using document root <none> and password file <none>
I20260812 06:13:29.056543 9862 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:29.056586 9862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:29.056685 9862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:29.057760 9862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "a758de3503214036b00b84934ef81871"
format_stamp: "Formatted at 2026-08-12 06:13:29 on dist-test-slave-gw5c"
server_key: "a1e20add96a19ec5da03f56781113ab6"
server_key_iv: "a2531eca6d9c4b0a046540cc49b8b29b"
server_key_version: "encryptionkey@0"
I20260812 06:13:29.058176 9862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "a758de3503214036b00b84934ef81871"
format_stamp: "Formatted at 2026-08-12 06:13:29 on dist-test-slave-gw5c"
server_key: "a1e20add96a19ec5da03f56781113ab6"
server_key_iv: "a2531eca6d9c4b0a046540cc49b8b29b"
server_key_version: "encryptionkey@0"
I20260812 06:13:29.059739 9862 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260812 06:13:29.060554 9882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:29.060760 9862 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:29.060854 9862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "a758de3503214036b00b84934ef81871"
format_stamp: "Formatted at 2026-08-12 06:13:29 on dist-test-slave-gw5c"
server_key: "a1e20add96a19ec5da03f56781113ab6"
server_key_iv: "a2531eca6d9c4b0a046540cc49b8b29b"
server_key_version: "encryptionkey@0"
I20260812 06:13:29.060942 9862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:29.086458 9862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:29.089051 9862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:29.089236 9862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:29.094316 9862 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:41191
I20260812 06:13:29.094354 9976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:41191 every 8 connection(s)
I20260812 06:13:29.094903 9862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:29.095745 9977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:29.098184 9977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871: Bootstrap starting.
I20260812 06:13:29.098773 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 9862
I20260812 06:13:29.098899 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:29.099043 9977 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:29.099134 707 external_mini_cluster.cc:1428] Setting key 8bc820f7bc8bb4eff029df4dab3b109c
I20260812 06:13:29.099433 9977 log.cc:824] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:29.100358 9977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871: No bootstrap required, opened a new log
I20260812 06:13:29.102931 9977 raft_consensus.cc:348] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a758de3503214036b00b84934ef81871" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41191 } }
I20260812 06:13:29.103132 9977 raft_consensus.cc:374] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:29.103176 9977 raft_consensus.cc:729] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a758de3503214036b00b84934ef81871, State: Initialized, Role: FOLLOWER
I20260812 06:13:29.103340 9977 consensus_queue.cc:260] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a758de3503214036b00b84934ef81871" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41191 } }
I20260812 06:13:29.103464 9977 raft_consensus.cc:388] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:29.103518 9977 raft_consensus.cc:482] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:29.103569 9977 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:29.104378 9977 raft_consensus.cc:504] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a758de3503214036b00b84934ef81871" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41191 } }
I20260812 06:13:29.104493 9977 leader_election.cc:302] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a758de3503214036b00b84934ef81871; no voters:
I20260812 06:13:29.104677 9977 leader_election.cc:288] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:29.104727 9987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:29.104895 9987 raft_consensus.cc:686] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [term 1 LEADER]: Becoming Leader. State: Replica: a758de3503214036b00b84934ef81871, State: Running, Role: LEADER
I20260812 06:13:29.104944 9977 sys_catalog.cc:564] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:29.105022 9987 consensus_queue.cc:237] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a758de3503214036b00b84934ef81871" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41191 } }
I20260812 06:13:29.105479 9990 sys_catalog.cc:455] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a758de3503214036b00b84934ef81871" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a758de3503214036b00b84934ef81871" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41191 } } }
I20260812 06:13:29.105563 9990 sys_catalog.cc:458] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:29.105738 9991 sys_catalog.cc:455] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a758de3503214036b00b84934ef81871. Latest consensus state: current_term: 1 leader_uuid: "a758de3503214036b00b84934ef81871" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a758de3503214036b00b84934ef81871" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41191 } } }
I20260812 06:13:29.105854 9991 sys_catalog.cc:458] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:29.106020 9999 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:29.106547 9999 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:29.108743 9999 catalog_manager.cc:1347] Generated new cluster ID: 54ebfcd2812f4ad4b46d0c98672393ab
I20260812 06:13:29.108798 9999 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:29.112416 9983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:29.099851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59948 (local address 127.0.176.254:41191)
0812 06:13:29.100031 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:29.100040 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:29.100082 (+ 42us) server_negotiation.cc:407] Connection header received
0812 06:13:29.100733 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:29.100743 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:29.100809 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:29.100966 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:29.101635 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.103117 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.104281 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.104949 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.105418 (+ 469us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:29.108363 (+ 2945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:29.108368 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:29.108369 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:29.108383 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:29.110606 (+ 2223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.111069 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.111073 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.111073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.111189 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.111429 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.111430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.111431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.111765 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:29.111957 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:29.112029 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 06:13:29.112179 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
I20260812 06:13:29.118538 9999 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:29.119143 9999 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:29.121361 9999 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a758de3503214036b00b84934ef81871: Generated new TSK 0
I20260812 06:13:29.121549 9999 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:13:29.156211 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:41191
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:35419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:29.246043 10026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:29.246272 10026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:29.246297 10026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:29.247567 10026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:29.247619 10026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:29.247646 10026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:29.249215 10026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:35419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:41191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:29.249477 10026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:29.249743 10026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:29.254900 10032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:29.255025 10031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:29.254911 10035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:29.255352 10026 server_base.cc:1034] running on GCE node
I20260812 06:13:29.255647 10026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:29.255908 10026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:29.257074 10026 hybrid_clock.cc:648] HybridClock initialized: now 1786515209257068 us; error 36 us; skew 500 ppm
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:29.260155 10026 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:13:29.260654 10026 webserver.cc:460] Webserver started at http://127.0.176.193:45215/ using document root <none> and password file <none>
I20260812 06:13:29.260898 10026 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:29.260970 10026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:29.261123 10026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:29.262288 10026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "521f065b7125464690b5ef5303b759b7"
format_stamp: "Formatted at 2026-08-12 06:13:29 on dist-test-slave-gw5c"
server_key: "390e3a9abcca1201a2d9446b28b95b4a"
server_key_iv: "2ad964c54228721c21442515eb116aa5"
server_key_version: "encryptionkey@0"
I20260812 06:13:29.262669 10026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "521f065b7125464690b5ef5303b759b7"
format_stamp: "Formatted at 2026-08-12 06:13:29 on dist-test-slave-gw5c"
server_key: "390e3a9abcca1201a2d9446b28b95b4a"
server_key_iv: "2ad964c54228721c21442515eb116aa5"
server_key_version: "encryptionkey@0"
I20260812 06:13:29.264254 10026 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:13:29.265177 10044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:29.265349 10026 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:29.265461 10026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "521f065b7125464690b5ef5303b759b7"
format_stamp: "Formatted at 2026-08-12 06:13:29 on dist-test-slave-gw5c"
server_key: "390e3a9abcca1201a2d9446b28b95b4a"
server_key_iv: "2ad964c54228721c21442515eb116aa5"
server_key_version: "encryptionkey@0"
I20260812 06:13:29.265539 10026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:29.276160 10026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:29.278247 10026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:29.278430 10026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:29.278692 10026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:29.279054 10026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:29.279111 10026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:29.279155 10026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:29.279198 10026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:29.285686 10026 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:34185
I20260812 06:13:29.285782 10250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:34185 every 8 connection(s)
I20260812 06:13:29.286123 10026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:29.292713 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 10026
I20260812 06:13:29.292877 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:29.293114 707 external_mini_cluster.cc:1428] Setting key 132410b096e0382b88f36e4102937160
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:29.297196 9983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:29.287072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:43655 (local address 127.0.176.254:41191)
0812 06:13:29.287163 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:29.287166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:29.287445 (+ 279us) server_negotiation.cc:407] Connection header received
0812 06:13:29.288468 (+ 1023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:29.288469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:29.288482 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:29.288548 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:29.289199 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.289731 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.290913 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.291122 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.291191 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:29.294017 (+ 2826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:29.294018 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:29.294018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:29.294025 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:29.295625 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.296121 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.296123 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.296123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.296187 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.296466 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.296467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.296467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.296614 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:29.296697 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:29.297042 (+ 345us) server_negotiation.cc:299] Negotiation successful
0812 06:13:29.297127 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:13:29.297490 10255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:29.287053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:41191 (local address 127.0.176.193:43655)
0812 06:13:29.287250 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:29.287310 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:29.288336 (+ 1026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:29.288615 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:29.288619 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:29.288908 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:29.289109 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:29.289113 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.289848 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.289849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:29.290793 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:29.290797 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.291213 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.291214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:29.291329 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:29.292002 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:29.292011 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:29.293930 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:29.295738 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:29.295748 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:29.295751 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:29.296020 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:29.296268 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:29.296269 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:29.296269 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:29.296397 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:29.296687 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:29.296695 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:29.296890 (+ 195us) client_negotiation.cc:769] Sending connection context
0812 06:13:29.297010 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 06:13:29.297206 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":95,"threads_started":1}
I20260812 06:13:29.298116 10251 heartbeater.cc:347] Connected to a master server at 127.0.176.254:41191
I20260812 06:13:29.298240 10251 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:29.298442 10251 heartbeater.cc:511] Master 127.0.176.254:41191 requested a full tablet report, sending...
I20260812 06:13:29.299047 9910 ts_manager.cc:194] Registered new tserver with Master: 521f065b7125464690b5ef5303b759b7 (127.0.176.193:34185)
I20260812 06:13:29.299774 9910 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:43655
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:13:29.321934 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:41191
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:35419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:29.411068 10266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:29.411320 10266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:29.411360 10266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:29.412590 10266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:29.412665 10266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:29.412714 10266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:29.414301 10266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:35419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:41191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:29.414603 10266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:29.414865 10266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:29.420361 10273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:29.420421 10278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:29.420485 10266 server_base.cc:1034] running on GCE node
W20260812 06:13:29.420393 10275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:29.420783 10266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:29.421113 10266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:29.422289 10266 hybrid_clock.cc:648] HybridClock initialized: now 1786515209422276 us; error 47 us; skew 500 ppm
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:29.425107 10266 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:13:29.425593 10266 webserver.cc:460] Webserver started at http://127.0.176.194:41305/ using document root <none> and password file <none>
I20260812 06:13:29.425858 10266 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:29.425933 10266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:29.426090 10266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:29.427207 10266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "16e74dfba1fd40aab71500007482e795"
format_stamp: "Formatted at 2026-08-12 06:13:29 on dist-test-slave-gw5c"
server_key: "fe514c559e1104b68b1d3319f5307c80"
server_key_iv: "993f112a0e52f1bb210d8ce1ab417d59"
server_key_version: "encryptionkey@0"
I20260812 06:13:29.427626 10266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "16e74dfba1fd40aab71500007482e795"
format_stamp: "Formatted at 2026-08-12 06:13:29 on dist-test-slave-gw5c"
server_key: "fe514c559e1104b68b1d3319f5307c80"
server_key_iv: "993f112a0e52f1bb210d8ce1ab417d59"
server_key_version: "encryptionkey@0"
I20260812 06:13:29.429071 10266 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:29.430195 10288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:29.430433 10266 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:29.430558 10266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "16e74dfba1fd40aab71500007482e795"
format_stamp: "Formatted at 2026-08-12 06:13:29 on dist-test-slave-gw5c"
server_key: "fe514c559e1104b68b1d3319f5307c80"
server_key_iv: "993f112a0e52f1bb210d8ce1ab417d59"
server_key_version: "encryptionkey@0"
I20260812 06:13:29.430656 10266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:29.446659 10266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:29.449519 10266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:29.449726 10266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:29.450013 10266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:29.450379 10266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:29.450441 10266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:29.450495 10266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:29.450527 10266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:29.457056 10266 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:40727
I20260812 06:13:29.457119 10500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:40727 every 8 connection(s)
I20260812 06:13:29.457474 10266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:13:29.459179 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 10266
I20260812 06:13:29.459327 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:13:29.459583 707 external_mini_cluster.cc:1428] Setting key d47b667fb43b2e9ca1371933df1a56aa
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:29.468788 9983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:29.458340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:56945 (local address 127.0.176.254:41191)
0812 06:13:29.458414 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:29.458416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:29.458627 (+ 211us) server_negotiation.cc:407] Connection header received
0812 06:13:29.459673 (+ 1046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:29.459675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:29.459691 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:29.459776 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:29.460665 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.461400 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.462447 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.462663 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.462747 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:29.465616 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:29.465618 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:29.465619 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:29.465628 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:29.467136 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.467678 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.467680 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.467680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.467744 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.468021 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.468021 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.468022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.468149 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:29.468223 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:29.468600 (+ 377us) server_negotiation.cc:299] Negotiation successful
0812 06:13:29.468690 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:13:29.469014 10503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:29.458304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:41191 (local address 127.0.176.194:56945)
0812 06:13:29.458470 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:29.458514 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:29.459561 (+ 1047us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:29.459862 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:29.459868 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:29.460269 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:29.460574 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:29.460578 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.461510 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.461511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:29.462319 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:29.462321 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.462758 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.462760 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:29.462905 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:29.463539 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:29.463550 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:29.465497 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:29.467247 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:29.467256 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:29.467259 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:29.467591 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:29.467813 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:29.467814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:29.467815 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:29.467943 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:29.468226 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:29.468234 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:29.468391 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 06:13:29.468559 (+ 168us) client_negotiation.cc:240] Negotiation successful
0812 06:13:29.468742 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":91,"threads_started":1}
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
I20260812 06:13:29.469499 10501 heartbeater.cc:347] Connected to a master server at 127.0.176.254:41191
I20260812 06:13:29.469624 10501 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:29.469844 10501 heartbeater.cc:511] Master 127.0.176.254:41191 requested a full tablet report, sending...
I20260812 06:13:29.470257 9910 ts_manager.cc:194] Registered new tserver with Master: 16e74dfba1fd40aab71500007482e795 (127.0.176.194:40727)
I20260812 06:13:29.470664 9910 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:56945
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:13:29.486546 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:41191
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:35419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:29.578600 10512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:29.578896 10512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:29.578945 10512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:29.580338 10512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:29.580420 10512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:29.580476 10512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:29.582157 10512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:35419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:41191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:29.582464 10512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:29.582729 10512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:29.588115 10526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:29.588138 10523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:29.588343 10512 server_base.cc:1034] running on GCE node
W20260812 06:13:29.588115 10524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:29.588719 10512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:29.589032 10512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:29.590188 10512 hybrid_clock.cc:648] HybridClock initialized: now 1786515209590175 us; error 35 us; skew 500 ppm
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:29.593199 10512 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:13:29.593683 10512 webserver.cc:460] Webserver started at http://127.0.176.195:43169/ using document root <none> and password file <none>
I20260812 06:13:29.593914 10512 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:29.593968 10512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:29.594070 10512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:29.595559 10512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "80ceaf4f9eb74cf8aa9c670b241ff5c2"
format_stamp: "Formatted at 2026-08-12 06:13:29 on dist-test-slave-gw5c"
server_key: "39b741414dd887d8973ec7d40ac659af"
server_key_iv: "e0b82a967c825c683d4026233249ae33"
server_key_version: "encryptionkey@0"
I20260812 06:13:29.595927 10512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "80ceaf4f9eb74cf8aa9c670b241ff5c2"
format_stamp: "Formatted at 2026-08-12 06:13:29 on dist-test-slave-gw5c"
server_key: "39b741414dd887d8973ec7d40ac659af"
server_key_iv: "e0b82a967c825c683d4026233249ae33"
server_key_version: "encryptionkey@0"
I20260812 06:13:29.597445 10512 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:29.598474 10541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:29.598874 10512 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:29.599124 10512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "80ceaf4f9eb74cf8aa9c670b241ff5c2"
format_stamp: "Formatted at 2026-08-12 06:13:29 on dist-test-slave-gw5c"
server_key: "39b741414dd887d8973ec7d40ac659af"
server_key_iv: "e0b82a967c825c683d4026233249ae33"
server_key_version: "encryptionkey@0"
I20260812 06:13:29.599231 10512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:29.609839 10512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:29.613462 10512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:29.613644 10512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:29.613930 10512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:29.614372 10512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:29.614434 10512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:29.614483 10512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:29.614509 10512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:29.622594 10512 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:38821
I20260812 06:13:29.622648 10735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:38821 every 8 connection(s)
I20260812 06:13:29.623071 10512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:13:29.623250 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 10512
I20260812 06:13:29.623370 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:13:29.623658 707 external_mini_cluster.cc:1428] Setting key 139d6b6b67f2adf2bd14edfe20ec7385
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:29.633787 9983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:29.624060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:57675 (local address 127.0.176.254:41191)
0812 06:13:29.624110 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:29.624116 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:29.624448 (+ 332us) server_negotiation.cc:407] Connection header received
0812 06:13:29.625499 (+ 1051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:29.625500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:29.625511 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:29.625563 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:29.626297 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.626818 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.627974 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.628162 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.628218 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:29.630799 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:29.630800 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:29.630800 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:29.630809 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:29.632412 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.632839 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.632840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.632840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.632898 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.633125 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.633125 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.633126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.633237 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:29.633288 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:29.633616 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 06:13:29.633695 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:13:29.634039 10738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:29.624056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:41191 (local address 127.0.176.195:57675)
0812 06:13:29.624248 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:29.624301 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:29.625389 (+ 1088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:29.625620 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:29.625624 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:29.625970 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:29.626184 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:29.626189 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.626928 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.626929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:29.627894 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:29.627896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.628241 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.628242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:29.628345 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:29.629002 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:29.629011 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:29.630651 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:29.632495 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:29.632503 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:29.632505 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:29.632762 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:29.632962 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:29.632962 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:29.632963 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:29.633069 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:29.633292 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:29.633296 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:29.633486 (+ 190us) client_negotiation.cc:769] Sending connection context
0812 06:13:29.633580 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 06:13:29.633718 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":90,"threads_started":1}
I20260812 06:13:29.634759 10736 heartbeater.cc:347] Connected to a master server at 127.0.176.254:41191
I20260812 06:13:29.635006 10736 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:29.635443 10736 heartbeater.cc:511] Master 127.0.176.254:41191 requested a full tablet report, sending...
I20260812 06:13:29.635937 9910 ts_manager.cc:194] Registered new tserver with Master: 80ceaf4f9eb74cf8aa9c670b241ff5c2 (127.0.176.195:38821)
I20260812 06:13:29.636298 9910 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:57675
I20260812 06:13:29.647708 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/test-admin.keytab.
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:29.665524 707 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 06:13:29.667495 10746 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:29.666516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53736 (local address 127.0.176.193:34185)
0812 06:13:29.666742 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:29.666747 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:29.666759 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:13:29.666787 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:29.666789 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:29.666803 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:29.666927 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:29.667380 (+ 453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53736: BlockingRecv error: recv got EOF from 127.0.0.1:53736 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":114,"threads_started":1}
W20260812 06:13:29.667655 707 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/krb5cc' of type FILE
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:29.668951 707 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:29.670053 707 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.193@KRBTEST.COM
I20260812 06:13:29.679674 10746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:29.670703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53738 (local address 127.0.176.193:34185)
0812 06:13:29.670779 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:29.670781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:29.670813 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:13:29.670930 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:29.670931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:29.670944 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:29.671003 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:29.671475 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.672256 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.673065 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.673441 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.673544 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:29.676059 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:29.676077 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:29.676077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:29.676090 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:29.678170 (+ 2080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.678668 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.678680 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.678680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.678752 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.678979 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.678980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.678981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.679178 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:29.679379 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:29.679452 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 06:13:29.679545 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260812 06:13:29.682675 10746 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:29.681280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53750 (local address 127.0.176.193:34185)
0812 06:13:29.681812 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:29.681815 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:29.681824 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:29.681849 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:29.681850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:29.681861 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:29.681938 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:29.682629 (+ 691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53750: BlockingRecv error: recv got EOF from 127.0.0.1:53750 (error 108)
Metrics: {"server-negotiator.queue_time_us":494}
W20260812 06:13:29.682902 707 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/krb5cc' of type FILE
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:29.684394 707 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:29.685518 707 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.193@KRBTEST.COM
I20260812 06:13:29.694207 10746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:29.686282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53756 (local address 127.0.176.193:34185)
0812 06:13:29.686407 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:29.686409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:29.686420 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:29.686447 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:29.686448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:29.686460 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:29.686526 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:29.687049 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.687672 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.688409 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.688620 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.688679 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:29.691177 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:29.691179 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:29.691179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:29.691191 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:29.692932 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.693341 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.693342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.693343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.693411 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.693621 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.693622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.693622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.693740 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:29.693845 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:29.693996 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 06:13:29.694092 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260812 06:13:29.696295 10746 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:29.695491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53764 (local address 127.0.176.193:34185)
0812 06:13:29.695535 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:29.695537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:29.695695 (+ 158us) server_negotiation.cc:407] Connection header received
0812 06:13:29.695720 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:29.695721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:29.695731 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:29.695788 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:29.696242 (+ 454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53764: BlockingRecv error: recv got EOF from 127.0.0.1:53764 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 06:13:29.696399 707 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515178947866-707-0/krb5kdc/krb5cc' of type FILE
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:29.697482 707 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:29.698500 707 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[9837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.193@KRBTEST.COM
I20260812 06:13:29.706862 10746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:29.699104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53766 (local address 127.0.176.193:34185)
0812 06:13:29.699177 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:29.699179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:29.699267 (+ 88us) server_negotiation.cc:407] Connection header received
0812 06:13:29.699381 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:29.699382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:29.699445 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:29.699506 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:29.699907 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.700420 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.701137 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:29.701399 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:29.701493 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:29.704039 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:29.704041 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:29.704041 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:29.704050 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:29.705595 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.706057 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.706057 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.706058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.706116 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:29.706299 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:29.706299 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:29.706300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:29.706425 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:29.706508 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:29.706710 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 06:13:29.706789 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 06:13:29.707947 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 10026
I20260812 06:13:29.734546 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 10266
I20260812 06:13:29.746179 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 10512
I20260812 06:13:29.763998 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 9862
2026-08-12T06:13:29Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2273 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[10765](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[10765](info): set up 2 sockets
Aug 12 06:13:29 dist-test-slave-gw5c krb5kdc[10765](info): commencing operation
krb5kdc: starting...
W20260812 06:13:31.070479 707 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:31 dist-test-slave-gw5c krb5kdc[10765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:31Z Disabled control of system clock
WARNING: no policy specified for oryx/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.254.keytab.
Entry for principal oryx/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.254.keytab.
I20260812 06:13:31.211088 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:34377
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.254.keytab
--principal=oryx/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:45757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:34377
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:31.300958 10793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:31.301204 10793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:31.301230 10793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:31.302490 10793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:31.302546 10793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:31.302561 10793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:31.302574 10793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:31.302587 10793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:31.304308 10793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:45757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:34377
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.254.keytab
--principal=oryx/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:34377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:31.304605 10793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:31.304869 10793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:31.309983 10808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:31.310005 10806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:31.310010 10799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:31.310338 10793 server_base.cc:1034] running on GCE node
I20260812 06:13:31.310685 10793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:31.311010 10793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:31.312182 10793 hybrid_clock.cc:648] HybridClock initialized: now 1786515211312167 us; error 46 us; skew 500 ppm
Aug 12 06:13:31 dist-test-slave-gw5c krb5kdc[10765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515211, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:31.314777 10793 init.cc:377] Logged in from keytab as oryx/127.0.176.254@KRBTEST.COM (short username oryx)
I20260812 06:13:31.315294 10793 webserver.cc:460] Webserver started at http://127.0.176.254:41291/ using document root <none> and password file <none>
I20260812 06:13:31.315593 10793 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:31.315665 10793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:31.315840 10793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:31.316967 10793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "7aacc2f45c92424bb770e47e1c36c4b0"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "bb8372f35b95318516f464a5d24a44ec"
server_key_iv: "dcfa886de170d95675f87f452e3eb853"
server_key_version: "encryptionkey@0"
I20260812 06:13:31.317356 10793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "7aacc2f45c92424bb770e47e1c36c4b0"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "bb8372f35b95318516f464a5d24a44ec"
server_key_iv: "dcfa886de170d95675f87f452e3eb853"
server_key_version: "encryptionkey@0"
I20260812 06:13:31.318794 10793 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:31.319665 10822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:31.319840 10793 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:31.319954 10793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "7aacc2f45c92424bb770e47e1c36c4b0"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "bb8372f35b95318516f464a5d24a44ec"
server_key_iv: "dcfa886de170d95675f87f452e3eb853"
server_key_version: "encryptionkey@0"
I20260812 06:13:31.320039 10793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:31.336570 10793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:31.338776 10793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:31.338989 10793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:31.343484 10793 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:34377
I20260812 06:13:31.343532 10903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:34377 every 8 connection(s)
I20260812 06:13:31.344062 10793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:31.345212 10907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:31.347687 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 10793
I20260812 06:13:31.347826 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:31.347832 10907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0: Bootstrap starting.
I20260812 06:13:31.348039 707 external_mini_cluster.cc:1428] Setting key 91a958d971bf1baf3cde4e8ff8606ec6
I20260812 06:13:31.348547 10907 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:31.348973 10907 log.cc:824] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:31.349799 10907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0: No bootstrap required, opened a new log
I20260812 06:13:31.352249 10907 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } }
I20260812 06:13:31.352479 10907 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:31.352555 10907 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aacc2f45c92424bb770e47e1c36c4b0, State: Initialized, Role: FOLLOWER
I20260812 06:13:31.352700 10907 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } }
I20260812 06:13:31.352777 10907 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:31.352820 10907 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:31.352874 10907 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:31.353804 10907 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } }
I20260812 06:13:31.353967 10907 leader_election.cc:302] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7aacc2f45c92424bb770e47e1c36c4b0; no voters:
I20260812 06:13:31.354187 10907 leader_election.cc:288] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:31.354212 10916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:31.354338 10916 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [term 1 LEADER]: Becoming Leader. State: Replica: 7aacc2f45c92424bb770e47e1c36c4b0, State: Running, Role: LEADER
I20260812 06:13:31.354450 10916 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } }
I20260812 06:13:31.354521 10907 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:31.354799 10916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } }
I20260812 06:13:31.354975 10916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:31.355183 10916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7aacc2f45c92424bb770e47e1c36c4b0. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } }
I20260812 06:13:31.355321 10916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:31.355721 10926 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 06:13:31 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
I20260812 06:13:31.356336 10926 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:31.358366 10926 catalog_manager.cc:1347] Generated new cluster ID: 18f656aed3714ee093cd4c132e7bd524
I20260812 06:13:31.358443 10926 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:31.360956 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:31.348656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60362 (local address 127.0.176.254:34377)
0812 06:13:31.348846 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:31.348861 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:31.348892 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:13:31.349398 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:31.349405 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:31.349456 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:31.349576 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:31.350407 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.351281 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.352507 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.353151 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.353242 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:31.356803 (+ 3561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:31.356808 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:31.356809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:31.356822 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:31.359050 (+ 2228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:31.359549 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:31.359553 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:31.359553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:31.359671 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:31.359922 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:31.359923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:31.359923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:31.360263 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:31.360433 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:31.360547 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 06:13:31.360705 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":85,"threads_started":1}
I20260812 06:13:31.376883 10926 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:31.377704 10926 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:31.384698 10926 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0: Generated new TSK 0
I20260812 06:13:31.384953 10926 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab.
Entry for principal oryx/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab.
I20260812 06:13:31.420121 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:34377
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab
--principal=oryx/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:45757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:31.522372 10948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:31.522637 10948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:31.522666 10948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:31.524111 10948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:31.524173 10948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:31.524206 10948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:31.525919 10948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:45757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab
--principal=oryx/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:34377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:31.526224 10948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:31.526492 10948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:31.532019 10957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:31.532023 10962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:31.532120 10948 server_base.cc:1034] running on GCE node
W20260812 06:13:31.532023 10958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:31.532487 10948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:31.532788 10948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:31.534015 10948 hybrid_clock.cc:648] HybridClock initialized: now 1786515211533956 us; error 82 us; skew 500 ppm
Aug 12 06:13:31 dist-test-slave-gw5c krb5kdc[10765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515211, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:31.537083 10948 init.cc:377] Logged in from keytab as oryx/127.0.176.193@KRBTEST.COM (short username oryx)
I20260812 06:13:31.537716 10948 webserver.cc:460] Webserver started at http://127.0.176.193:38925/ using document root <none> and password file <none>
I20260812 06:13:31.537992 10948 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:31.538071 10948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:31.538244 10948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:31.539573 10948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "cf45cb20e47f422f8d238e7d6641cb0a"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "6f504ae91005563dcd1e48b08d594a08"
server_key_iv: "b832a1792220b1c0d0f6dc4a18a77f0a"
server_key_version: "encryptionkey@0"
I20260812 06:13:31.540014 10948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "cf45cb20e47f422f8d238e7d6641cb0a"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "6f504ae91005563dcd1e48b08d594a08"
server_key_iv: "b832a1792220b1c0d0f6dc4a18a77f0a"
server_key_version: "encryptionkey@0"
I20260812 06:13:31.541656 10948 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:31.542585 10973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:31.542846 10948 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:31.542984 10948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "cf45cb20e47f422f8d238e7d6641cb0a"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "6f504ae91005563dcd1e48b08d594a08"
server_key_iv: "b832a1792220b1c0d0f6dc4a18a77f0a"
server_key_version: "encryptionkey@0"
I20260812 06:13:31.543071 10948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:31.559337 10948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:31.562120 10948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:31.562261 10948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:31.562484 10948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:31.562876 10948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:31.562954 10948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:31.563004 10948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:31.563025 10948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:31.569718 10948 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:45165
I20260812 06:13:31.569831 11184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:45165 every 8 connection(s)
I20260812 06:13:31.570276 10948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:13:31 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515211, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
I20260812 06:13:31.578480 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 10948
I20260812 06:13:31.578614 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:31.578896 707 external_mini_cluster.cc:1428] Setting key 457a60c33a2f7c17e734629aa7736022
I20260812 06:13:31.581393 11192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:31.571159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.193:52241)
0812 06:13:31.571329 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:31.571374 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:31.571914 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:31.572140 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:31.572144 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:31.572771 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:31.572991 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:31.572996 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.573974 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.573975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:31.574852 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:31.574854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.575262 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.575262 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:31.575372 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:31.576078 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:31.576088 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:31.577791 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:31.579934 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:31.579943 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:31.579945 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:31.580197 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:31.580427 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:31.580428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:31.580428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:31.580523 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:31.580827 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:31.580832 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:31.580974 (+ 142us) client_negotiation.cc:769] Sending connection context
0812 06:13:31.581061 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 06:13:31.581203 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260812 06:13:31.581383 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:31.571186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:52241 (local address 127.0.176.254:34377)
0812 06:13:31.571261 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:31.571262 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:31.571497 (+ 235us) server_negotiation.cc:407] Connection header received
0812 06:13:31.572009 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:31.572011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:31.572021 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:31.572085 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:31.573099 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.573845 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.574959 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.575166 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.575228 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:31.577951 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:31.577953 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:31.577954 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:31.577963 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:31.579842 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:31.580280 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:31.580282 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:31.580282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:31.580355 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:31.580587 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:31.580588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:31.580588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:31.580753 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:31.580835 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:31.581109 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 06:13:31.581235 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:13:31.582013 11187 heartbeater.cc:347] Connected to a master server at 127.0.176.254:34377
I20260812 06:13:31.582150 11187 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:31.582392 11187 heartbeater.cc:511] Master 127.0.176.254:34377 requested a full tablet report, sending...
I20260812 06:13:31.583081 10850 ts_manager.cc:194] Registered new tserver with Master: cf45cb20e47f422f8d238e7d6641cb0a (127.0.176.193:45165)
I20260812 06:13:31.584090 10850 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:52241
WARNING: no policy specified for oryx/127.0.176.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab.
Entry for principal oryx/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab.
I20260812 06:13:31.607024 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:34377
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab
--principal=oryx/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:45757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:31.694630 11196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:31.694880 11196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:31.694908 11196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:31.696453 11196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:31.696527 11196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:31.696560 11196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:31.698279 11196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:45757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab
--principal=oryx/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:34377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:31.698590 11196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:31.698885 11196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:31.704504 11207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:31.704491 11206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:31.704492 11210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:31.704842 11196 server_base.cc:1034] running on GCE node
I20260812 06:13:31.705084 11196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:31.705320 11196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:31.706527 11196 hybrid_clock.cc:648] HybridClock initialized: now 1786515211706509 us; error 33 us; skew 500 ppm
Aug 12 06:13:31 dist-test-slave-gw5c krb5kdc[10765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515211, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:31.709558 11196 init.cc:377] Logged in from keytab as oryx/127.0.176.194@KRBTEST.COM (short username oryx)
I20260812 06:13:31.710042 11196 webserver.cc:460] Webserver started at http://127.0.176.194:43607/ using document root <none> and password file <none>
I20260812 06:13:31.710301 11196 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:31.710350 11196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:31.710485 11196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:31.712006 11196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "5b2e3abf780e4257951f00b670da4be5"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "0f90c6fd880077e59da1ee8e4ac36a45"
server_key_iv: "9276a2b75e86105ae27ee4ece020d660"
server_key_version: "encryptionkey@0"
I20260812 06:13:31.712383 11196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "5b2e3abf780e4257951f00b670da4be5"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "0f90c6fd880077e59da1ee8e4ac36a45"
server_key_iv: "9276a2b75e86105ae27ee4ece020d660"
server_key_version: "encryptionkey@0"
I20260812 06:13:31.713891 11196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:31.714872 11224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:31.715159 11196 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:31.715276 11196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "5b2e3abf780e4257951f00b670da4be5"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "0f90c6fd880077e59da1ee8e4ac36a45"
server_key_iv: "9276a2b75e86105ae27ee4ece020d660"
server_key_version: "encryptionkey@0"
I20260812 06:13:31.715381 11196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:31.732568 11196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:31.735047 11196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:31.735249 11196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:31.735615 11196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:31.735980 11196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:31.736040 11196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:31.736084 11196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:31.736116 11196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:31.742425 11196 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:39591
I20260812 06:13:31.742466 11419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:39591 every 8 connection(s)
I20260812 06:13:31.742965 11196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:13:31.743643 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 11196
I20260812 06:13:31.743770 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:13:31.744012 707 external_mini_cluster.cc:1428] Setting key 25baecd7a22a5dcfb78bc4a460e9406f
Aug 12 06:13:31 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515211, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.0.176.195@KRBTEST.COM; defaulting to no policy
I20260812 06:13:31.754354 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:31.743802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:41867 (local address 127.0.176.254:34377)
0812 06:13:31.743858 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:31.743861 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:31.744131 (+ 270us) server_negotiation.cc:407] Connection header received
0812 06:13:31.744747 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:31.744748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:31.744759 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:31.744817 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:31.745980 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.746503 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.748110 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.748309 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.748377 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:31.751020 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:31.751022 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:31.751022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:31.751031 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:31.752795 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:31.753268 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:31.753269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:31.753270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:31.753344 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:31.753619 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:31.753620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:31.753621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:31.753790 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:31.753868 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:31.754127 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 06:13:31.754228 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:13:31.754705 11424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:31.743782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.194:41867)
0812 06:13:31.743989 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:31.744041 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:31.744644 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:31.744893 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:31.744898 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:31.745634 (+ 736us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:31.745840 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:31.745846 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.746610 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.746611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:31.748003 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:31.748007 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.748411 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.748413 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:31.748567 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:31.749149 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:31.749160 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:31.750902 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:31.752914 (+ 2012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:31.752923 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:31.752925 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:31.753176 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:31.753432 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:31.753433 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:31.753433 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:31.753545 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:31.753859 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:31.753864 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:31.753992 (+ 128us) client_negotiation.cc:769] Sending connection context
0812 06:13:31.754078 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 06:13:31.754437 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":99,"threads_started":1}
I20260812 06:13:31.755332 11420 heartbeater.cc:347] Connected to a master server at 127.0.176.254:34377
I20260812 06:13:31.755496 11420 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:31.755757 11420 heartbeater.cc:511] Master 127.0.176.254:34377 requested a full tablet report, sending...
I20260812 06:13:31.756239 10850 ts_manager.cc:194] Registered new tserver with Master: 5b2e3abf780e4257951f00b670da4be5 (127.0.176.194:39591)
I20260812 06:13:31.756670 10850 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:41867
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab.
Entry for principal oryx/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab.
I20260812 06:13:31.772282 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:34377
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab
--principal=oryx/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:45757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:31.861954 11431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:31.862192 11431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:31.862221 11431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:31.863459 11431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:31.863528 11431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:31.863559 11431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:31.865906 11431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:45757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab
--principal=oryx/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:34377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:31.866153 11431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:31.866356 11431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:31.871750 11441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:31.871724 11438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:31.871848 11439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:31.871901 11431 server_base.cc:1034] running on GCE node
I20260812 06:13:31.872288 11431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:31.872586 11431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:31.873807 11431 hybrid_clock.cc:648] HybridClock initialized: now 1786515211873790 us; error 25 us; skew 500 ppm
Aug 12 06:13:31 dist-test-slave-gw5c krb5kdc[10765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515211, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:31.876823 11431 init.cc:377] Logged in from keytab as oryx/127.0.176.195@KRBTEST.COM (short username oryx)
I20260812 06:13:31.877331 11431 webserver.cc:460] Webserver started at http://127.0.176.195:35365/ using document root <none> and password file <none>
I20260812 06:13:31.877578 11431 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:31.877650 11431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:31.877825 11431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:31.879040 11431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "eef9430ae97f4fd2b00099aca4e39238"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "41a7a89f265183dc0d2515f89210eb1e"
server_key_iv: "772c3bdc6fb046a14a84478db5df6868"
server_key_version: "encryptionkey@0"
I20260812 06:13:31.879515 11431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "eef9430ae97f4fd2b00099aca4e39238"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "41a7a89f265183dc0d2515f89210eb1e"
server_key_iv: "772c3bdc6fb046a14a84478db5df6868"
server_key_version: "encryptionkey@0"
I20260812 06:13:31.880995 11431 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:31.881904 11453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:31.882149 11431 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:31.882264 11431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "eef9430ae97f4fd2b00099aca4e39238"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "41a7a89f265183dc0d2515f89210eb1e"
server_key_iv: "772c3bdc6fb046a14a84478db5df6868"
server_key_version: "encryptionkey@0"
I20260812 06:13:31.882361 11431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:31.891995 11431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:31.894414 11431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:31.894618 11431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:31.894892 11431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:31.895231 11431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:31.895287 11431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:31.895335 11431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:31.895365 11431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:31.902230 11431 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:33733
I20260812 06:13:31.902268 11651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:33733 every 8 connection(s)
I20260812 06:13:31.902637 11431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:13:31.908631 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 11431
I20260812 06:13:31.908716 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
Aug 12 06:13:31 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515211, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
I20260812 06:13:31.908921 707 external_mini_cluster.cc:1428] Setting key 6b8d82b50c7ba9f6270f3fd2b83ac134
I20260812 06:13:31.912465 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:31.903496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:36233 (local address 127.0.176.254:34377)
0812 06:13:31.903573 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:31.903575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:31.903771 (+ 196us) server_negotiation.cc:407] Connection header received
0812 06:13:31.904238 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:31.904239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:31.904249 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:31.904303 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:31.905229 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.905724 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.906734 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.906974 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.907029 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:31.909243 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:31.909245 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:31.909245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:31.909253 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:31.910910 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:31.911433 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:31.911435 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:31.911435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:31.911500 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:31.911757 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:31.911758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:31.911759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:31.911898 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:31.911974 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:31.912269 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 06:13:31.912361 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 06:13:31.912689 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:31.903453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.195:36233)
0812 06:13:31.903649 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:31.903686 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:31.904159 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:31.904352 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:31.904355 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:31.904955 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:31.905150 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:31.905155 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.905806 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.905806 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:31.906609 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:31.906611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:31.907052 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:31.907053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:31.907157 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:31.907694 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:31.907702 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:31.909150 (+ 1448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:31.911022 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:31.911031 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:31.911033 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:31.911317 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:31.911568 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:31.911568 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:31.911569 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:31.911687 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:31.911976 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:31.911984 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:31.912133 (+ 149us) client_negotiation.cc:769] Sending connection context
0812 06:13:31.912246 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 06:13:31.912437 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":115,"threads_started":1}
I20260812 06:13:31.913231 11655 heartbeater.cc:347] Connected to a master server at 127.0.176.254:34377
I20260812 06:13:31.913343 11655 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:31.913547 11655 heartbeater.cc:511] Master 127.0.176.254:34377 requested a full tablet report, sending...
I20260812 06:13:31.913988 10850 ts_manager.cc:194] Registered new tserver with Master: eef9430ae97f4fd2b00099aca4e39238 (127.0.176.195:33733)
I20260812 06:13:31.914424 10850 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:36233
I20260812 06:13:31.921123 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.0.176.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.176.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.176.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.253.keytab.
Entry for principal oryx/127.0.176.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.253.keytab.
I20260812 06:13:31.948621 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.253:39533
--webserver_interface=127.0.176.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.253.keytab
--principal=oryx/127.0.176.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:45757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:34377,127.0.176.253:39533
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:32.039850 11664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:32.040099 11664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:32.040126 11664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:32.041568 11664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:32.041625 11664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:32.041640 11664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:32.041653 11664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:32.041666 11664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:32.043622 11664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:45757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:34377,127.0.176.253:39533
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.253.keytab
--principal=oryx/127.0.176.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.253:39533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.176.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
W20260812 06:13:32.043807 11664 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.0.176.254:34377,127.0.176.253:39533'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 06:13:32.043977 11664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:32.044236 11664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:32.049439 11675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:32.049471 11681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:32.049641 11664 server_base.cc:1034] running on GCE node
W20260812 06:13:32.049721 11679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:32.049994 11664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:32.050319 11664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:32.051528 11664 hybrid_clock.cc:648] HybridClock initialized: now 1786515212051517 us; error 54 us; skew 500 ppm
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:32.054430 11664 init.cc:377] Logged in from keytab as oryx/127.0.176.253@KRBTEST.COM (short username oryx)
I20260812 06:13:32.054958 11664 webserver.cc:460] Webserver started at http://127.0.176.253:37591/ using document root <none> and password file <none>
I20260812 06:13:32.055244 11664 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:32.055291 11664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:32.055454 11664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:32.056526 11664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/data/instance:
uuid: "f73ddc1404ea49a497de5f3e4f199385"
format_stamp: "Formatted at 2026-08-12 06:13:32 on dist-test-slave-gw5c"
server_key: "f2952d0b1c9460783a138737d677e35c"
server_key_iv: "b8b3056f3521adde1666f2879c3e4ba0"
server_key_version: "encryptionkey@0"
I20260812 06:13:32.056845 11664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/wal/instance:
uuid: "f73ddc1404ea49a497de5f3e4f199385"
format_stamp: "Formatted at 2026-08-12 06:13:32 on dist-test-slave-gw5c"
server_key: "f2952d0b1c9460783a138737d677e35c"
server_key_iv: "b8b3056f3521adde1666f2879c3e4ba0"
server_key_version: "encryptionkey@0"
I20260812 06:13:32.058203 11664 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:32.058943 11691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.059154 11664 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:32.059249 11664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/wal
uuid: "f73ddc1404ea49a497de5f3e4f199385"
format_stamp: "Formatted at 2026-08-12 06:13:32 on dist-test-slave-gw5c"
server_key: "f2952d0b1c9460783a138737d677e35c"
server_key_iv: "b8b3056f3521adde1666f2879c3e4ba0"
server_key_version: "encryptionkey@0"
I20260812 06:13:32.059329 11664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:32.084059 11664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:32.086715 11664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:32.086856 11664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:32.091315 11664 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.253:39533
I20260812 06:13:32.091393 11776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.253:39533 every 8 connection(s)
I20260812 06:13:32.092000 11664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/data/info.pb
I20260812 06:13:32.093124 11780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:32.094812 11780 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:13:32.095971 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 11664
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.253@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.176.253@KRBTEST.COM
I20260812 06:13:32.106771 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.095826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60366 (local address 127.0.176.254:34377)
0812 06:13:32.095916 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.095919 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.096182 (+ 263us) server_negotiation.cc:407] Connection header received
0812 06:13:32.096903 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.096905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.096917 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.096988 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.097818 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.098617 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.099885 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.100152 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.100225 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.103013 (+ 2788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.103015 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.103016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.103024 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.104982 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.105544 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.105545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.105545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.105600 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.105878 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.105879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.105879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.106107 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.106216 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.106542 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.106655 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 06:13:32.106945 11782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.095712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:60366)
0812 06:13:32.096022 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.096086 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.096800 (+ 714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.097044 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.097047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.097445 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.097714 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.097720 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.098718 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.098719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.099803 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.099805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.100242 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.100243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.100344 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.101062 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.101071 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.102899 (+ 1828us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.105072 (+ 2173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.105079 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.105082 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.105459 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.105672 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.105673 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.105673 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.105798 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.106201 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.106206 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.106399 (+ 193us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.106505 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.106685 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":124,"threads_started":1}
I20260812 06:13:32.107038 11787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.096540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58096 (local address 127.0.176.253:39533)
0812 06:13:32.096730 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.096736 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.096793 (+ 57us) server_negotiation.cc:407] Connection header received
0812 06:13:32.096899 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.096901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.096924 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.097011 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.097816 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.098951 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.100008 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.100422 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.100480 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.103751 (+ 3271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.103758 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.103759 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.103765 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.105591 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.105986 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.105989 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.105989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.106037 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.106259 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.106260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.106260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.106435 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.106586 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.106687 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.106755 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":113,"threads_started":1}
I20260812 06:13:32.108385 11780 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.253@KRBTEST.COM for oryx/127.0.176.253@KRBTEST.COM
I20260812 06:13:32.116024 11787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.108815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58102 (local address 127.0.176.253:39533)
0812 06:13:32.108854 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.108856 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.108865 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:32.108926 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.108927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.108937 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.108991 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.109291 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.109776 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.110433 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.110789 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.110872 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.112871 (+ 1999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.112873 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.112873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.112880 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.114187 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.114576 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.114655 (+ 79us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.114656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.114735 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.114967 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.114968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.114969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.115095 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.115175 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.115765 (+ 590us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.115905 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":24}
I20260812 06:13:32.116083 11782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.108724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:39533 (local address 127.0.0.1:58102)
0812 06:13:32.108811 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.108825 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.108870 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.108995 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.108996 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.109142 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.109193 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.109194 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.109861 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.109862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.110335 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.110337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.110889 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.110890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.110961 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.111376 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.111381 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.112758 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.114307 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.114309 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.114309 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.114487 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.114821 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.114822 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.114822 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.114898 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.115164 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.115165 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.115205 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.115732 (+ 527us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.115962 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70,"mutex_wait_us":113}
I20260812 06:13:32.117718 11780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: Bootstrap starting.
I20260812 06:13:32.118721 11780 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:32.119081 11780 log.cc:824] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:32.120057 11780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: No bootstrap required, opened a new log
I20260812 06:13:32.121618 11780 raft_consensus.cc:348] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } }
I20260812 06:13:32.121755 11780 raft_consensus.cc:374] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:32.121778 11780 raft_consensus.cc:729] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f73ddc1404ea49a497de5f3e4f199385, State: Initialized, Role: FOLLOWER
I20260812 06:13:32.121927 11780 consensus_queue.cc:260] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } }
I20260812 06:13:32.122234 11789 sys_catalog.cc:455] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } } }
I20260812 06:13:32.122336 11789 sys_catalog.cc:458] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:13:32.122349 11780 sys_catalog.cc:564] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 06:13:32.124418 11810 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:13:32.124483 11810 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:13:32.126348 11664 master_runner.cc:428] Detected that this master f73ddc1404ea49a497de5f3e4f199385 is joining an existing cluster
I20260812 06:13:32.126408 11664 master_runner.cc:432] Initiating AddMaster RPC to add 127.0.176.253:39533
I20260812 06:13:32.136134 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.127667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60372 (local address 127.0.176.254:34377)
0812 06:13:32.127714 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.127716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.128365 (+ 649us) server_negotiation.cc:407] Connection header received
0812 06:13:32.128392 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.128392 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.128403 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.128459 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.128959 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.129459 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.130668 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.130991 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.131070 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.132857 (+ 1787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.132859 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.132859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.132875 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.134691 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.135189 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.135190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.135190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.135259 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.135517 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.135519 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.135519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.135684 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.135751 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.135946 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.136031 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:13:32.136153 11824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.127575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:60372)
0812 06:13:32.128110 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.128122 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.128183 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.128482 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.128483 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.128647 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.128713 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.128714 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.129547 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.129548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.130570 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.130571 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.131083 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.131084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.131144 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.131920 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.131925 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.132742 (+ 817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.134803 (+ 2061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.134804 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.134805 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.135063 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.135331 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.135332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.135332 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.135449 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.135778 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.135779 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.135831 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.135905 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.136031 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"mutex_wait_us":62,"thread_start_us":487,"threads_started":1}
I20260812 06:13:32.136296 11822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.127572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:39533 (local address 127.0.0.1:58118)
0812 06:13:32.127774 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.127786 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.127864 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.128332 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.128332 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.128583 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.128702 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.128704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.129646 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.129646 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.130568 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.130571 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.131557 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.131558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.131721 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.132089 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.132093 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.132742 (+ 649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.135134 (+ 2392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.135135 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.135136 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.135366 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.135605 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.135606 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.135606 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.135677 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.135988 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.135989 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.136023 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.136081 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.136187 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":3,"thread_start_us":88,"threads_started":1}
I20260812 06:13:32.136579 11787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.128142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58118 (local address 127.0.176.253:39533)
0812 06:13:32.128212 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.128214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.128222 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:13:32.128244 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.128245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.128255 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.128329 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.128811 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.129563 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.131135 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.131463 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.131528 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.133178 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.133179 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.133179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.133186 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.135041 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.135480 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.135481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.135481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.135539 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.135751 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.135752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.135752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.135897 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.135965 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.136401 (+ 436us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.136502 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515211, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.254@KRBTEST.COM for oryx/127.0.176.253@KRBTEST.COM
I20260812 06:13:32.149056 11826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.139708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:39533 (local address 127.0.0.1:58128)
0812 06:13:32.140242 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.140303 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.140389 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.140627 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.140633 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.141059 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.141149 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.141152 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.142195 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.142196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.142814 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.142816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.143349 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.143350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.143496 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.144116 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.144121 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.145796 (+ 1675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.147898 (+ 2102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.147907 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.147918 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.148154 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.148370 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.148371 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.148371 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.148430 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.148715 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.148723 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.148777 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.148851 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.148977 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":120,"threads_started":1}
I20260812 06:13:32.149096 11787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.139976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58128 (local address 127.0.176.253:39533)
0812 06:13:32.140062 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.140064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.140400 (+ 336us) server_negotiation.cc:407] Connection header received
0812 06:13:32.140495 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.140496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.140507 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.140618 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.141255 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.142090 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.142912 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.143238 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.143335 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.145905 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.145906 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.145907 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.145916 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.147761 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.148234 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.148235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.148236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.148301 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.148494 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.148495 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.148495 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.148645 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.148718 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.148902 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.148993 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 06:13:32.149771 10850 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.0.176.253:39533: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385"
member_type: NON_VOTER
last_known_addr {
host: "127.0.176.253"
port: 39533
}
attrs {
promote: true
}
}
dest_uuid: "7aacc2f45c92424bb770e47e1c36c4b0"
cas_config_opid_index: -1
I20260812 06:13:32.150144 10850 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true } }
I20260812 06:13:32.150744 11829 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER f73ddc1404ea49a497de5f3e4f199385 (127.0.176.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true } } }
I20260812 06:13:32.151067 11733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:32.151995 11829 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.0.176.253:39533
I20260812 06:13:32.152001 11733 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 FOLLOWER]: Refusing update from remote peer 7aacc2f45c92424bb770e47e1c36c4b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 06:13:32.152251 11828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true } } }
I20260812 06:13:32.152311 11829 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:32.152462 11664 master.cc:537] Master@127.0.176.253:39533 shutting down...
I20260812 06:13:32.152470 11828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: This master's current role is: LEADER
W20260812 06:13:32.153903 10823 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 06:13:32.154597 10823 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 -> Peer f73ddc1404ea49a497de5f3e4f199385 (127.0.176.253:39533): Couldn't send request to peer f73ddc1404ea49a497de5f3e4f199385. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:13:32.156206 11664 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:32.156320 11664 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:32.156375 11664 tablet_replica.cc:330] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: stopping tablet replica
I20260812 06:13:32.159682 11664 master.cc:552] Master@127.0.176.253:39533 shutdown complete.
I20260812 06:13:32.159752 11664 master_runner.cc:305] Clearing existing system tablet
I20260812 06:13:32.159893 11664 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:32.159946 11664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:32.160764 11664 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:32.161392 11837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.161550 11664 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:32.161615 11664 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:13:32.161640 11664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/wal
uuid: "f73ddc1404ea49a497de5f3e4f199385"
format_stamp: "Formatted at 2026-08-12 06:13:32 on dist-test-slave-gw5c"
server_key: "f2952d0b1c9460783a138737d677e35c"
server_key_iv: "b8b3056f3521adde1666f2879c3e4ba0"
server_key_version: "encryptionkey@0"
I20260812 06:13:32.162474 11664 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:32.164000 11664 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 06:13:32.164084 11664 log.cc:1196] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 06:13:32.164291 11664 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: Deleting consensus metadata
I20260812 06:13:32.164423 11664 master_runner.cc:315] Copying system tablet from 127.0.176.254:34377
I20260812 06:13:32.165105 11664 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: tablet copy: Beginning tablet copy session from remote peer at address 127.0.176.254:34377
I20260812 06:13:32.171494 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.165528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60386 (local address 127.0.176.254:34377)
0812 06:13:32.165597 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.165599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.165695 (+ 96us) server_negotiation.cc:407] Connection header received
0812 06:13:32.165797 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.165798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.165810 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.165880 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.166225 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.166733 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.167515 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.167726 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.167817 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.168891 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.168893 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.168893 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.168910 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.170269 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.170632 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.170633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.170634 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.170698 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.170913 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.170914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.170914 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.171036 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.171116 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.171272 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.171363 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:13:32.171723 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.165453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:60386)
0812 06:13:32.165595 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.165608 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.165718 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.165887 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.165887 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.166076 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.166131 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.166133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.166823 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.166824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.167377 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.167379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.167821 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.167822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.167898 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.168437 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.168442 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.168774 (+ 332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.170373 (+ 1599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.170374 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.170375 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.170559 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.170768 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.170769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.170769 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.170835 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.171105 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.171106 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.171156 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.171243 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.171371 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":78,"threads_started":1}
I20260812 06:13:32.172130 10879 tablet_copy_service.cc:140] P 7aacc2f45c92424bb770e47e1c36c4b0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer f73ddc1404ea49a497de5f3e4f199385 ({username='oryx', principal='oryx/127.0.176.253@KRBTEST.COM'} at 127.0.0.1:60386)
I20260812 06:13:32.172255 10879 tablet_copy_service.cc:161] P 7aacc2f45c92424bb770e47e1c36c4b0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer f73ddc1404ea49a497de5f3e4f199385 at {username='oryx', principal='oryx/127.0.176.253@KRBTEST.COM'} at 127.0.0.1:60386: session id = f73ddc1404ea49a497de5f3e4f199385-00000000000000000000000000000000
I20260812 06:13:32.173172 10879 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:13:32.173945 11664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 06:13:32.175527 11664 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: tablet copy: Starting download of 0 data blocks...
I20260812 06:13:32.175712 11664 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: tablet copy: Starting download of 1 WAL segments...
I20260812 06:13:32.176853 11664 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:13:32.177800 10879 tablet_copy_service.cc:342] P 7aacc2f45c92424bb770e47e1c36c4b0: Request end of tablet copy session f73ddc1404ea49a497de5f3e4f199385-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.0.176.253@KRBTEST.COM'} at 127.0.0.1:60386
I20260812 06:13:32.177876 10879 tablet_copy_service.cc:433] P 7aacc2f45c92424bb770e47e1c36c4b0: ending tablet copy session f73ddc1404ea49a497de5f3e4f199385-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer f73ddc1404ea49a497de5f3e4f199385
I20260812 06:13:32.180703 11664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:32.181929 11849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:32.181960 11848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:32.181998 11853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:32.182142 11664 server_base.cc:1034] running on GCE node
I20260812 06:13:32.182272 11664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:32.182444 11664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:32.183609 11664 hybrid_clock.cc:648] HybridClock initialized: now 1786515212183598 us; error 27 us; skew 500 ppm
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:32.185212 11664 init.cc:377] Logged in from keytab as oryx/127.0.176.253@KRBTEST.COM (short username oryx)
I20260812 06:13:32.185504 11664 webserver.cc:460] Webserver started at http://127.0.176.253:44253/ using document root <none> and password file <none>
I20260812 06:13:32.185635 11664 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:32.185672 11664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:32.186434 11664 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:32.187057 11864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.187213 11664 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:13:32.187270 11664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/wal
uuid: "f73ddc1404ea49a497de5f3e4f199385"
format_stamp: "Formatted at 2026-08-12 06:13:32 on dist-test-slave-gw5c"
server_key: "f2952d0b1c9460783a138737d677e35c"
server_key_iv: "b8b3056f3521adde1666f2879c3e4ba0"
server_key_version: "encryptionkey@0"
I20260812 06:13:32.187333 11664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:32.201968 11664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:32.204020 11664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:32.207412 11664 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.253:39533
I20260812 06:13:32.207701 11950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.253:39533 every 8 connection(s)
I20260812 06:13:32.207906 11664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-1/data/info.pb
I20260812 06:13:32.209165 11951 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:13:32.209791 11951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: Bootstrap starting.
I20260812 06:13:32.213230 11951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:13:32.213521 11951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: Bootstrap complete.
I20260812 06:13:32.213901 11951 raft_consensus.cc:348] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true } }
I20260812 06:13:32.214033 11951 raft_consensus.cc:729] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f73ddc1404ea49a497de5f3e4f199385, State: Initialized, Role: LEARNER
I20260812 06:13:32.214107 11951 consensus_queue.cc:260] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true } }
I20260812 06:13:32.214306 11951 sys_catalog.cc:564] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:32.214538 11963 sys_catalog.cc:455] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true } } }
I20260812 06:13:32.214684 11963 sys_catalog.cc:458] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: This master's current role is: LEARNER
I20260812 06:13:32.215844 11983 catalog_manager.cc:1259] Loaded cluster ID: 18f656aed3714ee093cd4c132e7bd524
I20260812 06:13:32.216024 11983 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: loading cluster ID for follower catalog manager: success
I20260812 06:13:32.217047 11983 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: acquiring CA information for follower catalog manager: success
I20260812 06:13:32.217361 11983 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:13:32.217803 11957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.208837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58136 (local address 127.0.176.253:39533)
0812 06:13:32.208974 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.208976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.209031 (+ 55us) server_negotiation.cc:407] Connection header received
0812 06:13:32.209109 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.209110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.209118 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.209205 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.209771 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.210476 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.211182 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.211527 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.211606 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.213236 (+ 1630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.213238 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.213238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.213246 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.215558 (+ 2312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.216592 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.216593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.216593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.216667 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.216906 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.216906 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.216907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.217059 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.217559 (+ 500us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.217603 (+ 44us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.217707 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":97,"threads_started":1}
WARNING: no policy specified for oryx/127.0.176.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.176.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.176.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.252.keytab.
Entry for principal oryx/127.0.176.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.252.keytab.
I20260812 06:13:32.249778 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.252:39477
--webserver_interface=127.0.176.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.252.keytab
--principal=oryx/127.0.176.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:45757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:34377,127.0.176.253:39533,127.0.176.252:39477
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:32.343734 11989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:32.344022 11989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:32.344065 11989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:32.345491 11989 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:32.345587 11989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:32.345884 11989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:32.345927 11989 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:32.345950 11989 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:32.348131 11989 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:45757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:34377,127.0.176.253:39533,127.0.176.252:39477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.252.keytab
--principal=oryx/127.0.176.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.252:39477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.176.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:32.348469 11989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:32.348749 11989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:32.354096 12001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:32.354082 12004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:32.354082 12000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:32.354511 11989 server_base.cc:1034] running on GCE node
I20260812 06:13:32.354846 11989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:32.355207 11989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:32.356411 11989 hybrid_clock.cc:648] HybridClock initialized: now 1786515212356407 us; error 46 us; skew 500 ppm
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:32.360572 11989 init.cc:377] Logged in from keytab as oryx/127.0.176.252@KRBTEST.COM (short username oryx)
I20260812 06:13:32.361810 11989 webserver.cc:460] Webserver started at http://127.0.176.252:42713/ using document root <none> and password file <none>
I20260812 06:13:32.362291 11989 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:32.362386 11989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:32.362546 11989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:32.364233 11989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/data/instance:
uuid: "2d3eb96ec62f4d33b45d52ccf9f02509"
format_stamp: "Formatted at 2026-08-12 06:13:32 on dist-test-slave-gw5c"
server_key: "9d2f2480a775d6fb9c2ef51013738fef"
server_key_iv: "1c920c22eda2038ad38be152e1136da5"
server_key_version: "encryptionkey@0"
I20260812 06:13:32.364660 11989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/wal/instance:
uuid: "2d3eb96ec62f4d33b45d52ccf9f02509"
format_stamp: "Formatted at 2026-08-12 06:13:32 on dist-test-slave-gw5c"
server_key: "9d2f2480a775d6fb9c2ef51013738fef"
server_key_iv: "1c920c22eda2038ad38be152e1136da5"
server_key_version: "encryptionkey@0"
I20260812 06:13:32.366310 11989 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:32.367540 12017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.367825 11989 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:32.367957 11989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/wal
uuid: "2d3eb96ec62f4d33b45d52ccf9f02509"
format_stamp: "Formatted at 2026-08-12 06:13:32 on dist-test-slave-gw5c"
server_key: "9d2f2480a775d6fb9c2ef51013738fef"
server_key_iv: "1c920c22eda2038ad38be152e1136da5"
server_key_version: "encryptionkey@0"
I20260812 06:13:32.368050 11989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:32.393497 11989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:32.396782 11989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:32.397013 11989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:32.401798 11989 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.252:39477
I20260812 06:13:32.401852 12107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.252:39477 every 8 connection(s)
I20260812 06:13:32.402307 11989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/data/info.pb
I20260812 06:13:32.403460 12108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:32.405184 12108 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:13:32.407282 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 11989
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.252@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.176.252@KRBTEST.COM
I20260812 06:13:32.417083 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.406185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60388 (local address 127.0.176.254:34377)
0812 06:13:32.406364 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.406366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.406392 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:13:32.406947 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.406949 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.406961 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.407081 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.407888 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.408553 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.409766 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.409973 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.410066 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.412616 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.412617 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.412617 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.412625 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.415062 (+ 2437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.415847 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.415848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.415849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.415930 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.416270 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.416271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.416271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.416427 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.416522 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.416877 (+ 355us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.416981 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260812 06:13:32.417302 12114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.406049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:60388)
0812 06:13:32.406264 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.406312 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.406817 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.407085 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.407089 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.407477 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.407762 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.407768 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.408835 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.408836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.409648 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.409650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.410096 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.410097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.410222 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.410815 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.410825 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.412500 (+ 1675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.415190 (+ 2690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.415204 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.415208 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.415695 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.416030 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.416032 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.416032 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.416178 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.416527 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.416535 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.416708 (+ 173us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.416838 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.417025 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":125,"threads_started":1}
I20260812 06:13:32.417927 12115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.408056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34686 (local address 127.0.176.252:39477)
0812 06:13:32.408280 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.408284 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.408301 (+ 17us) server_negotiation.cc:407] Connection header received
0812 06:13:32.408321 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.408322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.408338 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.408434 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.409066 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.409788 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.410524 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.410843 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.410932 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.413891 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.413901 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.413901 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.413909 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.416334 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.416733 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.416737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.416737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.416811 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.417024 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.417025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.417025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.417224 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.417650 (+ 426us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.417704 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.417797 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":140,"threads_started":1}
I20260812 06:13:32.417961 12108 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.252@KRBTEST.COM for oryx/127.0.176.253@KRBTEST.COM
I20260812 06:13:32.426124 12114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.418289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:39533 (local address 127.0.0.1:58140)
0812 06:13:32.418421 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.418431 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.418494 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.418738 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.418739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.418914 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.419002 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.419003 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.420007 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.420008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.420541 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.420543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.420944 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.420944 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.421015 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.421693 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.421699 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.423095 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.425056 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.425058 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.425058 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.425249 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.425476 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.425477 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.425477 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.425566 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.425847 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.425847 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.425896 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.425955 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.426048 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20260812 06:13:32.426142 11957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.418366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58140 (local address 127.0.176.253:39533)
0812 06:13:32.418423 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.418425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.418465 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:13:32.418576 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.418577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.418591 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.418657 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.419269 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.419882 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.420644 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.420869 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.420931 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.423194 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.423195 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.423195 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.423204 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.424944 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.425342 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.425343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.425344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.425408 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.425642 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.425643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.425643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.425780 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.425838 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.425992 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.426075 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:13:32.426959 12108 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.252@KRBTEST.COM for oryx/127.0.176.252@KRBTEST.COM
I20260812 06:13:32.433889 12115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.427423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34690 (local address 127.0.176.252:39477)
0812 06:13:32.427465 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.427467 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.427476 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:32.427494 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.427495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.427505 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.427561 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.427825 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.428328 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.429011 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.429237 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.429312 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.431199 (+ 1887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.431201 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.431201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.431209 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.432695 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.433071 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.433072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.433073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.433132 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.433324 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.433325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.433325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.433452 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.433530 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.433654 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.433753 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":23}
I20260812 06:13:32.433943 12114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.427265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39477 (local address 127.0.0.1:34690)
0812 06:13:32.427325 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.427336 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.427384 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.427565 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.427566 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.427718 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.427753 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.427754 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.428449 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.428450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.428925 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.428927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.429319 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.429320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.429376 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.429858 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.429864 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.431104 (+ 1240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.432804 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.432805 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.432806 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.432984 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.433198 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.433198 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.433199 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.433255 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.433518 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.433518 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.433557 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.433628 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.433816 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":91}
I20260812 06:13:32.435714 12108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: Bootstrap starting.
I20260812 06:13:32.436565 12108 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:32.437165 12108 log.cc:824] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:32.438223 12108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: No bootstrap required, opened a new log
I20260812 06:13:32.439906 12108 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } }
I20260812 06:13:32.440052 12108 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:32.440075 12108 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3eb96ec62f4d33b45d52ccf9f02509, State: Initialized, Role: FOLLOWER
I20260812 06:13:32.440213 12108 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } }
I20260812 06:13:32.440536 12108 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:32.440534 12118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } } }
I20260812 06:13:32.440795 12118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:13:32.442525 12132 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:13:32.442597 12132 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:13:32.445158 11989 master_runner.cc:428] Detected that this master 2d3eb96ec62f4d33b45d52ccf9f02509 is joining an existing cluster
I20260812 06:13:32.445240 11989 master_runner.cc:432] Initiating AddMaster RPC to add 127.0.176.252:39477
I20260812 06:13:32.455031 11957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.447189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58148 (local address 127.0.176.253:39533)
0812 06:13:32.447234 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.447236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.447513 (+ 277us) server_negotiation.cc:407] Connection header received
0812 06:13:32.447624 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.447625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.447636 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.447697 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.448124 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.448883 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.449985 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.450282 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.450323 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.452135 (+ 1812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.452136 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.452136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.452143 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.453557 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.453993 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.453994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.453994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.454053 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.454272 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.454272 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.454273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.454527 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.454621 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.454799 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.454897 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:13:32.455049 12153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.446952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:39533 (local address 127.0.0.1:58148)
0812 06:13:32.447413 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.447423 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.447540 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.447718 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.447719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.447950 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.448020 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.448022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.448991 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.448992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.449877 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.449881 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.450420 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.450422 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.450508 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.451525 (+ 1017us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.451530 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.452022 (+ 492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.453648 (+ 1626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.453649 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.453649 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.453884 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.454125 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.454126 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.454126 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.454207 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.454623 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.454623 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.454676 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.454752 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.454927 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"spinlock_wait_cycles":10496,"thread_start_us":114,"threads_started":1}
I20260812 06:13:32.471890 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 10948
I20260812 06:13:32.486948 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.446993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60392 (local address 127.0.176.254:34377)
0812 06:13:32.447043 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.447046 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.447175 (+ 129us) server_negotiation.cc:407] Connection header received
0812 06:13:32.447290 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.447291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.447306 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.447340 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.447905 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.448792 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.449945 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.450252 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.450295 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.472323 (+ 22028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.472325 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.472325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.472334 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.485428 (+ 13094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.485881 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.485882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.485883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.485938 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.486116 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.486117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.486117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.486277 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.486346 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.486669 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.486810 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:13:32.487177 12115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.447442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34704 (local address 127.0.176.252:39477)
0812 06:13:32.447493 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.447495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.447993 (+ 498us) server_negotiation.cc:407] Connection header received
0812 06:13:32.448068 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.448069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.448076 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.448100 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.448622 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.449295 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.450296 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.450557 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.450595 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.474235 (+ 23640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.474236 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.474237 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.474244 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.484612 (+ 10368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.486407 (+ 1795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.486408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.486408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.486459 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.486639 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.486640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.486640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.486748 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.486791 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.486979 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.487077 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:13:32.487713 12146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.446941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:60392)
0812 06:13:32.447111 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.447122 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.447204 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.447473 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.447474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.447728 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.447817 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.447819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.448881 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.448882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.449836 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.449839 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.450396 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.450397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.450456 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.471629 (+ 21173us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.471636 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.472182 (+ 546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.485558 (+ 13376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.485560 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.485561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.485798 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.485998 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.485999 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.485999 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.486054 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.486377 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.486378 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.486433 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.486503 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.487175 (+ 672us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":104,"threads_started":1}
I20260812 06:13:32.487716 12147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.447226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39477 (local address 127.0.0.1:34704)
0812 06:13:32.447945 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.447955 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.448012 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.448144 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.448145 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.448355 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.448513 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.448516 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.449378 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.449378 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.450214 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.450216 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.450660 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.450661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.450698 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.473780 (+ 23082us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.473787 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.474119 (+ 332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.486100 (+ 11981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.486101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.486102 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.486308 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.486524 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.486525 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.486525 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.486574 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.486831 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.486831 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.486881 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.487494 (+ 613us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.487601 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":703,"thread_start_us":75,"threads_started":1}
I20260812 06:13:32.500489 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:45165
--local_ip_for_outbound_sockets=127.0.176.193
--tserver_master_addrs=127.0.176.254:34377
--webserver_port=38925
--webserver_interface=127.0.176.193
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab
--principal=oryx/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:45757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.0.176.254:34377,127.0.176.253:39533
--tserver_master_addrs=127.0.176.254:34377,127.0.176.253:39533,127.0.176.252:39477 with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515211, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.254@KRBTEST.COM for oryx/127.0.176.252@KRBTEST.COM
I20260812 06:13:32.505851 12115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.496897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34708 (local address 127.0.176.252:39477)
0812 06:13:32.496959 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.496961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.496971 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:32.497037 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.497037 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.497048 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.497125 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.497541 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.498284 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.499508 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.499817 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.499889 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.502431 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.502433 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.502434 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.502443 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.504411 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.504896 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.504898 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.504899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.504967 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.505214 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.505215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.505215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.505380 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.505454 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.505650 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.505739 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:13:32.505927 11826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.496845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39477 (local address 127.0.0.1:34708)
0812 06:13:32.496908 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.496921 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.496966 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.497143 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.497144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.497382 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.497449 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.497452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.498384 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.498385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.499328 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.499332 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.499957 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.499958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.500037 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.500566 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.500572 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.502298 (+ 1726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.504532 (+ 2234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.504534 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.504534 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.504806 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.505051 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.505052 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.505053 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.505136 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.505462 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.505464 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.505527 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.505612 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.505756 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 06:13:32.506917 10850 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.0.176.252:39477: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509"
member_type: NON_VOTER
last_known_addr {
host: "127.0.176.252"
port: 39477
}
attrs {
promote: true
}
}
dest_uuid: "7aacc2f45c92424bb770e47e1c36c4b0"
cas_config_opid_index: 5
I20260812 06:13:32.507203 10850 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } }
I20260812 06:13:32.507817 11829 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 2d3eb96ec62f4d33b45d52ccf9f02509 (127.0.176.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } } }
I20260812 06:13:32.508868 11829 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.0.176.252:39477
I20260812 06:13:32.508956 11829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } } }
I20260812 06:13:32.509032 11829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:32.509636 11989 master.cc:537] Master@127.0.176.252:39477 shutting down...
I20260812 06:13:32.509791 12062 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:32.511245 12062 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 FOLLOWER]: Refusing update from remote peer 7aacc2f45c92424bb770e47e1c36c4b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 06:13:32.511597 12160 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:13:32.513060 10826 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 -> Peer 2d3eb96ec62f4d33b45d52ccf9f02509 (127.0.176.252:39477): Couldn't send request to peer 2d3eb96ec62f4d33b45d52ccf9f02509. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:13:32.516570 11826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.508031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:39533 (local address 127.0.0.1:58154)
0812 06:13:32.508117 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.508130 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.508174 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.510324 (+ 2150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.510327 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.510330 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:32.510389 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.510392 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.512780 (+ 2388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.512782 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.514195 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.514200 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.516273 (+ 2073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.516274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.516354 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.516384 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.516438 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.516489 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 06:13:32.517055 11957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.509191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58154 (local address 127.0.176.253:39533)
0812 06:13:32.509250 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.509252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.509266 (+ 14us) server_negotiation.cc:407] Connection header received
0812 06:13:32.509298 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.509298 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.509332 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.509446 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:32.511322 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.512456 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.514701 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.515350 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.516159 (+ 809us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.516242 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.516935 (+ 693us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.516988 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:13:32.517365 11907 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 LEARNER]: Refusing update from remote peer 7aacc2f45c92424bb770e47e1c36c4b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 06:13:32.517663 12160 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 06:13:32.517884 11989 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:32.517989 11989 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:32.518034 11989 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: stopping tablet replica
I20260812 06:13:32.518299 11907 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 2d3eb96ec62f4d33b45d52ccf9f02509 (127.0.176.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } } }
I20260812 06:13:32.519806 11963 sys_catalog.cc:455] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7aacc2f45c92424bb770e47e1c36c4b0. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } } }
I20260812 06:13:32.519907 11963 sys_catalog.cc:458] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: This master's current role is: LEARNER
I20260812 06:13:32.519948 11963 sys_catalog.cc:455] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: NON_VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: true } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } } }
I20260812 06:13:32.519992 11963 sys_catalog.cc:458] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: This master's current role is: LEARNER
I20260812 06:13:32.520504 12160 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0: attempting to promote NON_VOTER f73ddc1404ea49a497de5f3e4f199385 to VOTER
I20260812 06:13:32.520756 12160 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } }
I20260812 06:13:32.521370 11907 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 LEARNER]: Refusing update from remote peer 7aacc2f45c92424bb770e47e1c36c4b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 06:13:32.521579 12160 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 06:13:32.521701 11826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.521280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39477 (local address 127.0.0.1:34724)
0812 06:13:32.521613 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.521668 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312}
I20260812 06:13:32.522305 11826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.521921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39477 (local address 127.0.0.1:34726)
0812 06:13:32.522250 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.522280 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314}
W20260812 06:13:32.522397 10826 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 -> Peer 2d3eb96ec62f4d33b45d52ccf9f02509 (127.0.176.252:39477): Couldn't send request to peer 2d3eb96ec62f4d33b45d52ccf9f02509. Status: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:13:32.522414 11828 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f73ddc1404ea49a497de5f3e4f199385 (127.0.176.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } } }
I20260812 06:13:32.523686 11907 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f73ddc1404ea49a497de5f3e4f199385 (127.0.176.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } } }
I20260812 06:13:32.523854 11828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } } }
I20260812 06:13:32.523938 11828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:32.523990 11828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } } }
I20260812 06:13:32.524030 11828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:32.524725 12162 sys_catalog.cc:455] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } } }
I20260812 06:13:32.524822 12162 sys_catalog.cc:458] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:13:32.532161 11989 master.cc:552] Master@127.0.176.252:39477 shutdown complete.
I20260812 06:13:32.532227 11989 master_runner.cc:305] Clearing existing system tablet
I20260812 06:13:32.532366 11989 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:32.532423 11989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:32.533375 11989 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:13:32.533934 12169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.534039 11989 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:32.534085 11989 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:13:32.534106 11989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/wal
uuid: "2d3eb96ec62f4d33b45d52ccf9f02509"
format_stamp: "Formatted at 2026-08-12 06:13:32 on dist-test-slave-gw5c"
server_key: "9d2f2480a775d6fb9c2ef51013738fef"
server_key_iv: "1c920c22eda2038ad38be152e1136da5"
server_key_version: "encryptionkey@0"
I20260812 06:13:32.534817 11989 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:32.536373 11989 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 06:13:32.536449 11989 log.cc:1196] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 06:13:32.536654 11989 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: Deleting consensus metadata
I20260812 06:13:32.536818 11989 master_runner.cc:315] Copying system tablet from 127.0.176.254:34377
I20260812 06:13:32.537447 11989 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: tablet copy: Beginning tablet copy session from remote peer at address 127.0.176.254:34377
I20260812 06:13:32.547192 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.539756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60400 (local address 127.0.176.254:34377)
0812 06:13:32.539810 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.539812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.539972 (+ 160us) server_negotiation.cc:407] Connection header received
0812 06:13:32.540036 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.540037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.540053 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.540113 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.540563 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.541447 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.542481 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.542775 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.542857 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.544090 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.544092 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.544092 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.544100 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.545914 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.546364 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.546366 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.546366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.546428 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.546625 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.546626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.546626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.546751 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.546791 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.547008 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.547095 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:13:32.547528 12181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.539673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:60400)
0812 06:13:32.539867 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.539880 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.539960 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.540138 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.540139 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.540413 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.540469 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.540472 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.541548 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.541549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.542365 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.542379 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.542886 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.542887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.542951 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.543553 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.543559 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.543989 (+ 430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.546045 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.546047 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.546047 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.546278 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.546501 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.546501 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.546502 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.546560 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.546833 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.546834 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.546896 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.547290 (+ 394us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.547435 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":82,"threads_started":1}
I20260812 06:13:32.547761 10879 tablet_copy_service.cc:140] P 7aacc2f45c92424bb770e47e1c36c4b0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2d3eb96ec62f4d33b45d52ccf9f02509 ({username='oryx', principal='oryx/127.0.176.252@KRBTEST.COM'} at 127.0.0.1:60400)
I20260812 06:13:32.547823 10879 tablet_copy_service.cc:161] P 7aacc2f45c92424bb770e47e1c36c4b0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2d3eb96ec62f4d33b45d52ccf9f02509 at {username='oryx', principal='oryx/127.0.176.252@KRBTEST.COM'} at 127.0.0.1:60400: session id = 2d3eb96ec62f4d33b45d52ccf9f02509-00000000000000000000000000000000
I20260812 06:13:32.548440 10879 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:13:32.548930 11989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 06:13:32.550380 11989 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: tablet copy: Starting download of 0 data blocks...
I20260812 06:13:32.550527 11989 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: tablet copy: Starting download of 1 WAL segments...
I20260812 06:13:32.552084 11989 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:13:32.553186 10879 tablet_copy_service.cc:342] P 7aacc2f45c92424bb770e47e1c36c4b0: Request end of tablet copy session 2d3eb96ec62f4d33b45d52ccf9f02509-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.0.176.252@KRBTEST.COM'} at 127.0.0.1:60400
I20260812 06:13:32.553278 10879 tablet_copy_service.cc:433] P 7aacc2f45c92424bb770e47e1c36c4b0: ending tablet copy session 2d3eb96ec62f4d33b45d52ccf9f02509-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2d3eb96ec62f4d33b45d52ccf9f02509
I20260812 06:13:32.556406 11989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:32.557694 12182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:32.560235 12183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:32.560508 12185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:32.563588 11989 server_base.cc:1034] running on GCE node
I20260812 06:13:32.563786 11989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:32.563985 11989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:32.565120 11989 hybrid_clock.cc:648] HybridClock initialized: now 1786515212565098 us; error 45 us; skew 500 ppm
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:32.566828 11989 init.cc:377] Logged in from keytab as oryx/127.0.176.252@KRBTEST.COM (short username oryx)
I20260812 06:13:32.567129 11989 webserver.cc:460] Webserver started at http://127.0.176.252:45839/ using document root <none> and password file <none>
I20260812 06:13:32.567260 11989 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:32.567298 11989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:32.568148 11989 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:32.568797 12200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.568984 11989 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:13:32.569042 11989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/wal
uuid: "2d3eb96ec62f4d33b45d52ccf9f02509"
format_stamp: "Formatted at 2026-08-12 06:13:32 on dist-test-slave-gw5c"
server_key: "9d2f2480a775d6fb9c2ef51013738fef"
server_key_iv: "1c920c22eda2038ad38be152e1136da5"
server_key_version: "encryptionkey@0"
I20260812 06:13:32.569104 11989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:32.583717 11989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:32.586078 11989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:32.589876 11989 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.252:39477
I20260812 06:13:32.590258 11989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/master-2/data/info.pb
I20260812 06:13:32.591607 12306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.252:39477 every 8 connection(s)
I20260812 06:13:32.592485 12308 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:13:32.593070 12308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: Bootstrap starting.
I20260812 06:13:32.596944 12308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:13:32.597200 12308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: Bootstrap complete.
I20260812 06:13:32.597429 12308 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } }
I20260812 06:13:32.597530 12308 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2d3eb96ec62f4d33b45d52ccf9f02509, State: Initialized, Role: LEARNER
I20260812 06:13:32.597569 12308 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } }
I20260812 06:13:32.597815 12308 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:32.599520 12327 catalog_manager.cc:1259] Loaded cluster ID: 18f656aed3714ee093cd4c132e7bd524
I20260812 06:13:32.599645 12327 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: loading cluster ID for follower catalog manager: success
I20260812 06:13:32.600879 12327 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: acquiring CA information for follower catalog manager: success
I20260812 06:13:32.601226 12327 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:13:32.603541 12312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } } }
I20260812 06:13:32.603775 12312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: This master's current role is: LEARNER
W20260812 06:13:32.611860 12154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:32.612130 12154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:32.612175 12154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:32.613466 12154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:32.613546 12154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:32.613596 12154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:32.615705 12154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:45757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab
--principal=oryx/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:45165
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=38925
--tserver_master_addrs=127.0.176.254:34377,127.0.176.253:39533,127.0.176.252:39477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:32.616052 12154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:32.616336 12154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:32.622720 12337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:32.622764 12335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:32.622723 12334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:32.623178 12154 server_base.cc:1034] running on GCE node
I20260812 06:13:32.623441 12154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:32.623724 12154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:32.624925 12154 hybrid_clock.cc:648] HybridClock initialized: now 1786515212624910 us; error 52 us; skew 500 ppm
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:32.627921 12154 init.cc:377] Logged in from keytab as oryx/127.0.176.193@KRBTEST.COM (short username oryx)
I20260812 06:13:32.628422 12154 webserver.cc:460] Webserver started at http://127.0.176.193:38925/ using document root <none> and password file <none>
I20260812 06:13:32.628690 12154 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:32.628798 12154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:32.630339 12154 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:32.631047 12352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.631239 12154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:32.631356 12154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "cf45cb20e47f422f8d238e7d6641cb0a"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "6f504ae91005563dcd1e48b08d594a08"
server_key_iv: "b832a1792220b1c0d0f6dc4a18a77f0a"
server_key_version: "encryptionkey@0"
I20260812 06:13:32.631816 12154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:32.647164 12154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:32.649782 12154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:32.649981 12154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:32.650254 12154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:32.650595 12154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:32.650650 12154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.650697 12154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:32.650728 12154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.657363 12154 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:45165
I20260812 06:13:32.657450 12549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:45165 every 8 connection(s)
I20260812 06:13:32.657832 12154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:32.658514 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 12154
I20260812 06:13:32.658708 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 11196
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.253@KRBTEST.COM
I20260812 06:13:32.678814 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.658806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:56385 (local address 127.0.176.254:34377)
0812 06:13:32.658901 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.658903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.659276 (+ 373us) server_negotiation.cc:407] Connection header received
0812 06:13:32.661654 (+ 2378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.661656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.661671 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.661738 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.663807 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.664844 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.667028 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.667255 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.667331 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.670979 (+ 3648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.670981 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.670981 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.670989 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.676435 (+ 5446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.677139 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.677140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.677141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.677210 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.677561 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.677562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.677563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.677721 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.677775 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.678280 (+ 505us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.678668 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 06:13:32.680310 12558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.658664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.193:56385)
0812 06:13:32.658994 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.659045 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.659940 (+ 895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.661908 (+ 1968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.661915 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.663033 (+ 1118us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.663514 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.663524 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.665016 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.665017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.666873 (+ 1856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.666879 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.667432 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.667434 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.667652 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.668400 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.668414 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.670831 (+ 2417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.676536 (+ 5705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.676551 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.676554 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.677037 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.677282 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.677283 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.677283 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.677472 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.677902 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.677911 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.678112 (+ 201us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.679531 (+ 1419us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.679752 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":94,"threads_started":1}
I20260812 06:13:32.680342 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:39591
--local_ip_for_outbound_sockets=127.0.176.194
--tserver_master_addrs=127.0.176.254:34377
--webserver_port=43607
--webserver_interface=127.0.176.194
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab
--principal=oryx/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:45757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.0.176.254:34377,127.0.176.253:39533
--tserver_master_addrs=127.0.176.254:34377,127.0.176.253:39533,127.0.176.252:39477 with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:13:32.681337 11957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.658740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:45063 (local address 127.0.176.253:39533)
0812 06:13:32.658857 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.658859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.672859 (+ 14000us) server_negotiation.cc:407] Connection header received
0812 06:13:32.672967 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.672968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.672985 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.673047 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.673514 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.674186 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.675302 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.675689 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.675769 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.678098 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.678100 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.678100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.678108 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.679836 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.680228 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.680229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.680230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.680295 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.680536 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.680537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.680537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.680685 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.680730 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.681154 (+ 424us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.681243 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.252@KRBTEST.COM
I20260812 06:13:32.681731 12560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.658664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:39533 (local address 127.0.176.193:45063)
0812 06:13:32.672750 (+ 14086us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.672763 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.672880 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.673105 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.673106 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.673340 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.673427 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.673429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.674301 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.674302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.675181 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.675184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.675790 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.675791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.675872 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.676348 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.676354 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.677990 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.679917 (+ 1927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.679918 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.679918 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.680139 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.680378 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.680379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.680379 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.680450 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.680780 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.680782 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.680824 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.681494 (+ 670us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.681606 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14052,"mutex_wait_us":64,"thread_start_us":66,"threads_started":1}
I20260812 06:13:32.681984 12553 heartbeater.cc:347] Connected to a master server at 127.0.176.254:34377
I20260812 06:13:32.682096 12554 heartbeater.cc:347] Connected to a master server at 127.0.176.253:39533
I20260812 06:13:32.682147 12554 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:32.682101 12553 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:32.682365 12553 heartbeater.cc:511] Master 127.0.176.254:34377 requested a full tablet report, sending...
I20260812 06:13:32.682364 12554 heartbeater.cc:511] Master 127.0.176.253:39533 requested a full tablet report, sending...
I20260812 06:13:32.682897 10850 ts_manager.cc:194] Re-registered known tserver with Master: cf45cb20e47f422f8d238e7d6641cb0a (127.0.176.193:45165)
I20260812 06:13:32.683054 11891 ts_manager.cc:194] Registered new tserver with Master: cf45cb20e47f422f8d238e7d6641cb0a (127.0.176.193:45165)
I20260812 06:13:32.683457 10850 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:56385
I20260812 06:13:32.686132 12564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.659352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:52265 (local address 127.0.176.252:39477)
0812 06:13:32.663927 (+ 4575us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.663929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.675616 (+ 11687us) server_negotiation.cc:407] Connection header received
0812 06:13:32.676556 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.676558 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.676579 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.676651 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.677230 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.678261 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.679326 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.679694 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.679768 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.682518 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.682520 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.682520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.682530 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.684670 (+ 2140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.685174 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.685178 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.685178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.685289 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.685514 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.685515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.685515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.685625 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.685675 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.685848 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.685929 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4533,"thread_start_us":4507,"threads_started":1}
I20260812 06:13:32.686234 12563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.659007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39477 (local address 127.0.176.193:52265)
0812 06:13:32.675479 (+ 16472us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.675492 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.675551 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.676710 (+ 1159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.676711 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.677061 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.677129 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.677132 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.678353 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.678354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.679223 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.679226 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.679832 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.679833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.679909 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.680430 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.680435 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.682354 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.684768 (+ 2414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.684769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.684769 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.685045 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.685370 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.685371 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.685371 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.685448 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.685691 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.685692 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.685748 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.685832 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.686063 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16447,"thread_start_us":64,"threads_started":1}
I20260812 06:13:32.686888 12550 heartbeater.cc:347] Connected to a master server at 127.0.176.252:39477
I20260812 06:13:32.686946 12550 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:32.687065 12550 heartbeater.cc:511] Master 127.0.176.252:39477 requested a full tablet report, sending...
I20260812 06:13:32.687520 12231 ts_manager.cc:194] Registered new tserver with Master: cf45cb20e47f422f8d238e7d6641cb0a (127.0.176.193:45165)
W20260812 06:13:32.772104 12565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:32.772393 12565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:32.772441 12565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:32.773717 12565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:32.773803 12565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:32.773854 12565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:32.775593 12565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:45757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab
--principal=oryx/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:39591
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=43607
--tserver_master_addrs=127.0.176.254:34377,127.0.176.253:39533,127.0.176.252:39477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:32.775935 12565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:32.776203 12565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:32.781972 12580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:32.781980 12576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:32.782308 12578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:32.782338 12565 server_base.cc:1034] running on GCE node
I20260812 06:13:32.782553 12565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:32.782884 12565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:32.784049 12565 hybrid_clock.cc:648] HybridClock initialized: now 1786515212784025 us; error 45 us; skew 500 ppm
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:32.787129 12565 init.cc:377] Logged in from keytab as oryx/127.0.176.194@KRBTEST.COM (short username oryx)
I20260812 06:13:32.787837 12565 webserver.cc:460] Webserver started at http://127.0.176.194:43607/ using document root <none> and password file <none>
I20260812 06:13:32.788116 12565 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:32.788211 12565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:32.790055 12565 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:13:32.790895 12589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.791270 12565 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:32.791536 12565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "5b2e3abf780e4257951f00b670da4be5"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "0f90c6fd880077e59da1ee8e4ac36a45"
server_key_iv: "9276a2b75e86105ae27ee4ece020d660"
server_key_version: "encryptionkey@0"
I20260812 06:13:32.791996 12565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:32.808630 12565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:32.811332 12565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:32.811581 12565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:32.811856 12565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:32.812201 12565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:32.812256 12565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.812306 12565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:32.812336 12565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.822422 12565 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:39591
I20260812 06:13:32.822469 12793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:39591 every 8 connection(s)
I20260812 06:13:32.823182 12565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:13:32.828676 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 12565
I20260812 06:13:32.828855 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 11431
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.252@KRBTEST.COM
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.253@KRBTEST.COM
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
I20260812 06:13:32.837146 12564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.824571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:33797 (local address 127.0.176.252:39477)
0812 06:13:32.824612 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.824682 (+ 70us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.824892 (+ 210us) server_negotiation.cc:407] Connection header received
0812 06:13:32.825855 (+ 963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.825857 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.825873 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.825907 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.826969 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.827593 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.829024 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.829347 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.829408 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.833256 (+ 3848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.833257 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.833258 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.833266 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.834878 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.835865 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.835866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.835867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.835949 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.836290 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.836291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.836291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.836436 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.836521 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.836913 (+ 392us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.837021 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:13:32.837932 12801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.824470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39477 (local address 127.0.176.194:33797)
0812 06:13:32.824813 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.824825 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.825699 (+ 874us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.826005 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.826006 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.826527 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.826840 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.826846 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.827708 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.827709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.828903 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.828906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.829507 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.829508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.829659 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.830309 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.830320 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.833115 (+ 2795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.835348 (+ 2233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.835360 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.835363 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.835761 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.836038 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.836039 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.836039 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.836208 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.836510 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.836518 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.836721 (+ 203us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.837410 (+ 689us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.837622 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":60,"threads_started":1}
I20260812 06:13:32.838547 11957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.824190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:58501 (local address 127.0.176.253:39533)
0812 06:13:32.824247 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.824249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.824733 (+ 484us) server_negotiation.cc:407] Connection header received
0812 06:13:32.825820 (+ 1087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.825822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.825841 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.825899 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.828134 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.828732 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.829913 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.830233 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.830278 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.834971 (+ 4693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.834973 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.834974 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.834984 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.837215 (+ 2231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.837651 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.837653 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.837653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.837713 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.837912 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.837913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.837913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.838068 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.838118 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.838340 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.838448 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:13:32.838536 12794 heartbeater.cc:347] Connected to a master server at 127.0.176.252:39477
I20260812 06:13:32.838634 12794 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:32.838836 12794 heartbeater.cc:511] Master 127.0.176.252:39477 requested a full tablet report, sending...
I20260812 06:13:32.838914 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.824130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:39533 (local address 127.0.176.194:58501)
0812 06:13:32.824602 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.824612 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.825679 (+ 1067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.825981 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.825985 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.826557 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.826841 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.826847 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.829035 (+ 2188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.829036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.829784 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.829787 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.830365 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.830366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.830430 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.831353 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.831358 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.834822 (+ 3464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.837319 (+ 2497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.837321 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.837321 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.837556 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.837785 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.837786 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.837786 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.837841 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.838171 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.838172 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.838218 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.838664 (+ 446us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.838782 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"mutex_wait_us":39,"thread_start_us":108,"threads_started":1}
I20260812 06:13:32.839301 12799 heartbeater.cc:347] Connected to a master server at 127.0.176.253:39533
I20260812 06:13:32.839351 12799 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:32.839419 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.824103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:35633 (local address 127.0.176.254:34377)
0812 06:13:32.824169 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.824172 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.824492 (+ 320us) server_negotiation.cc:407] Connection header received
0812 06:13:32.825978 (+ 1486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.825979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.825992 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.826056 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.827502 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.828044 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.830625 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.830959 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.831007 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.835371 (+ 4364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:32.835374 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:32.835374 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:32.835437 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:32.837812 (+ 2375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.838312 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.838313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.838314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.838382 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:32.838628 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:32.838629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:32.838629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:32.838797 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:32.838849 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.839140 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.839244 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:13:32.839454 12799 heartbeater.cc:511] Master 127.0.176.253:39533 requested a full tablet report, sending...
I20260812 06:13:32.839572 12231 ts_manager.cc:194] Registered new tserver with Master: 5b2e3abf780e4257951f00b670da4be5 (127.0.176.194:39591)
I20260812 06:13:32.839771 11891 ts_manager.cc:194] Registered new tserver with Master: 5b2e3abf780e4257951f00b670da4be5 (127.0.176.194:39591)
I20260812 06:13:32.839895 12802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.824131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.194:35633)
0812 06:13:32.824333 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.824390 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.825674 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.826083 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.826084 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.826570 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.826841 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.826847 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.828126 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.828127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.828955 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.828958 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.831093 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.831093 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.831158 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.831986 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:32.831990 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:32.835254 (+ 3264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:32.837941 (+ 2687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.837943 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.837943 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.838209 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.838466 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:32.838467 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:32.838468 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:32.838542 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:32.838905 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:32.838906 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:32.838992 (+ 86us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.839524 (+ 532us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.839719 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":10,"thread_start_us":115,"threads_started":1}
I20260812 06:13:32.840317 12796 heartbeater.cc:347] Connected to a master server at 127.0.176.254:34377
I20260812 06:13:32.840371 12796 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:32.840426 12796 heartbeater.cc:511] Master 127.0.176.254:34377 requested a full tablet report, sending...
I20260812 06:13:32.840689 10850 ts_manager.cc:194] Re-registered known tserver with Master: 5b2e3abf780e4257951f00b670da4be5 (127.0.176.194:39591)
I20260812 06:13:32.841357 10850 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:35633
I20260812 06:13:32.858211 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:33733
--local_ip_for_outbound_sockets=127.0.176.195
--tserver_master_addrs=127.0.176.254:34377
--webserver_port=35365
--webserver_interface=127.0.176.195
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab
--principal=oryx/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:45757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.0.176.254:34377,127.0.176.253:39533
--tserver_master_addrs=127.0.176.254:34377,127.0.176.253:39533,127.0.176.252:39477 with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:32.950650 12804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:32.950973 12804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:32.951021 12804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:32.952462 12804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:32.952550 12804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:32.952603 12804 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:32.954425 12804 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:45757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab
--principal=oryx/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:33733
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=35365
--tserver_master_addrs=127.0.176.254:34377,127.0.176.253:39533,127.0.176.252:39477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:32.954727 12804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:32.955021 12804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:32.960314 12810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:32.960376 12813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:32.960364 12809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:32.960641 12804 server_base.cc:1034] running on GCE node
I20260812 06:13:32.960901 12804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:32.961170 12804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:32.962337 12804 hybrid_clock.cc:648] HybridClock initialized: now 1786515212962318 us; error 31 us; skew 500 ppm
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:32.965214 12804 init.cc:377] Logged in from keytab as oryx/127.0.176.195@KRBTEST.COM (short username oryx)
I20260812 06:13:32.965718 12804 webserver.cc:460] Webserver started at http://127.0.176.195:35365/ using document root <none> and password file <none>
I20260812 06:13:32.965991 12804 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:32.966080 12804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:32.967768 12804 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:32.968954 12829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.969305 12804 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:32.969506 12804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "eef9430ae97f4fd2b00099aca4e39238"
format_stamp: "Formatted at 2026-08-12 06:13:31 on dist-test-slave-gw5c"
server_key: "41a7a89f265183dc0d2515f89210eb1e"
server_key_iv: "772c3bdc6fb046a14a84478db5df6868"
server_key_version: "encryptionkey@0"
I20260812 06:13:32.970222 12804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:32.976068 11826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.972298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39477 (local address 127.0.0.1:34734)
0812 06:13:32.972349 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.972369 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.972417 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.972623 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.972623 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.972625 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:32.972677 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.972679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.973720 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.973723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.974943 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.974951 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.975812 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.975813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.975874 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.975878 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:13:32.975948 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:13:32.975999 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260812 06:13:32.976086 12564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.972381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34734 (local address 127.0.176.252:39477)
0812 06:13:32.972439 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.972441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.972455 (+ 14us) server_negotiation.cc:407] Connection header received
0812 06:13:32.972488 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.972489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.972515 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.972602 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:32.972749 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.973542 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.975058 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.975705 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.975784 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:32.975849 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:32.975972 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 06:13:32.976014 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:13:32.976833 12240 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 06:13:32.977223 12312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7aacc2f45c92424bb770e47e1c36c4b0. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } } }
I20260812 06:13:32.977396 12312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: This master's current role is: LEARNER
I20260812 06:13:32.982174 12804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:32.984973 12804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:32.985172 12804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:32.985468 12804 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:32.985798 12804 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:32.985853 12804 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.985900 12804 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:32.985929 12804 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:32.992511 12804 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:33733
I20260812 06:13:32.992554 13023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:33733 every 8 connection(s)
I20260812 06:13:32.992983 12804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:13:32.994990 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 12804
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.253@KRBTEST.COM
Aug 12 06:13:32 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
Aug 12 06:13:33 dist-test-slave-gw5c krb5kdc[10765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515212, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.252@KRBTEST.COM
I20260812 06:13:33.008904 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.993861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:39533 (local address 127.0.176.195:34847)
0812 06:13:32.994122 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.994131 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.995546 (+ 1415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.995799 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.995804 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.996474 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.997076 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.997079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.998353 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.998354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.999205 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.999207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.000295 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.000295 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.000362 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.000978 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:33.000989 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:33.003682 (+ 2693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:33.006701 (+ 3019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:33.006713 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:33.006715 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:33.007224 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:33.007535 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:33.007536 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:33.007537 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:33.007706 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:33.008043 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:33.008051 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:33.008247 (+ 196us) client_negotiation.cc:769] Sending connection context
0812 06:13:33.008391 (+ 144us) client_negotiation.cc:240] Negotiation successful
0812 06:13:33.008598 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":403,"thread_start_us":107,"threads_started":1}
I20260812 06:13:33.009274 11957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.993854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:34847 (local address 127.0.176.253:39533)
0812 06:13:32.993916 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.993918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.994219 (+ 301us) server_negotiation.cc:407] Connection header received
0812 06:13:32.995649 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.995651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.995665 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.995716 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.997152 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.997886 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.999304 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.999590 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.999644 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.003796 (+ 4152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:33.003797 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:33.003798 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:33.003806 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:33.006619 (+ 2813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.007329 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.007330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.007330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.007441 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.007789 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.007790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.007791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.007945 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:33.008010 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.009070 (+ 1060us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.009166 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:13:33.009727 13030 heartbeater.cc:347] Connected to a master server at 127.0.176.253:39533
I20260812 06:13:33.009837 13030 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:33.009972 13050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.996759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58170 (local address 127.0.176.253:39533)
0812 06:13:33.000575 (+ 3816us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:33.000578 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:33.000586 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:13:33.000610 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:33.000611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:33.000626 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:33.000695 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:33.002212 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.003006 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.004400 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.004823 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.004893 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.006455 (+ 1562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:33.006457 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:33.006457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:33.006466 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:33.008633 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.009079 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.009080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.009080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.009141 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.009363 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.009364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.009364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.009506 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:33.009584 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.009795 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.009888 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3791,"thread_start_us":56,"threads_started":1}
I20260812 06:13:33.010073 13030 heartbeater.cc:511] Master 127.0.176.253:39533 requested a full tablet report, sending...
I20260812 06:13:33.010114 13038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.994192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39477 (local address 127.0.176.195:40211)
0812 06:13:32.995947 (+ 1755us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.995961 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.996058 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.996280 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.996280 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.997319 (+ 1039us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.997397 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.997399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.999328 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.999329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.000194 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:33.000197 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.001456 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.001457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.001519 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.003437 (+ 1918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:33.003443 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:33.006863 (+ 3420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:33.008923 (+ 2060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:33.008924 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:33.008925 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:33.009144 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:33.009355 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:33.009356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:33.009356 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:33.009423 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:33.009711 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:33.009712 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:33.009758 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 06:13:33.009827 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:13:33.009941 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1721,"thread_start_us":60,"threads_started":1}
I20260812 06:13:33.010470 12564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.994280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:40211 (local address 127.0.176.252:39477)
0812 06:13:32.994322 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.994324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.996026 (+ 1702us) server_negotiation.cc:407] Connection header received
0812 06:13:32.996140 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.996141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.996161 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.996199 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.997498 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.998273 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.000289 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.001321 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.001400 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.006966 (+ 5566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:33.006967 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:33.006968 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:33.006976 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:33.008833 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.009227 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.009228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.009229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.009281 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.009492 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.009493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.009493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.009624 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:33.009683 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.010253 (+ 570us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.010351 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:13:33.010521 11891 ts_manager.cc:194] Registered new tserver with Master: eef9430ae97f4fd2b00099aca4e39238 (127.0.176.195:33733)
I20260812 06:13:33.011011 13027 heartbeater.cc:347] Connected to a master server at 127.0.176.252:39477
I20260812 06:13:33.011075 13027 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:33.011147 13027 heartbeater.cc:511] Master 127.0.176.252:39477 requested a full tablet report, sending...
I20260812 06:13:33.011523 12231 ts_manager.cc:194] Registered new tserver with Master: eef9430ae97f4fd2b00099aca4e39238 (127.0.176.195:33733)
I20260812 06:13:33.012319 13036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.993858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.195:54241)
0812 06:13:32.994066 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:32.994111 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:32.995379 (+ 1268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:32.995851 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:32.995852 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:32.996443 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:32.996799 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.996806 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.997976 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.997978 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:32.999218 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:32.999220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.999982 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.999983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.000164 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.001309 (+ 1145us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:33.001314 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:33.005297 (+ 3983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:33.010989 (+ 5692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:33.010990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:33.010991 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:33.011236 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:33.011531 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:33.011532 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:33.011532 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:33.011603 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:33.011951 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:33.011951 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:33.011997 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 06:13:33.012063 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 06:13:33.012172 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":3,"thread_start_us":118,"threads_started":1}
I20260812 06:13:33.012320 13046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.996482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60402 (local address 127.0.176.254:34377)
0812 06:13:32.996683 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.996685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.997171 (+ 486us) server_negotiation.cc:407] Connection header received
0812 06:13:32.997267 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.997268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.997282 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.997328 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.998255 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.999015 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.000126 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.000425 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.000510 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.002080 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:33.002082 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:33.002082 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:33.002089 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:33.004616 (+ 2527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.005066 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.005067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.005067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.005945 (+ 878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.011645 (+ 5700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.011646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.011647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.011815 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:33.011936 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.012087 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.012195 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":87,"threads_started":1}
I20260812 06:13:33.012655 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.993930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:54241 (local address 127.0.176.254:34377)
0812 06:13:32.993981 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.993983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:32.994270 (+ 287us) server_negotiation.cc:407] Connection header received
0812 06:13:32.995555 (+ 1285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:32.995558 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:32.995575 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:32.995743 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:32.996930 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.997793 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.999693 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:32.999874 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:32.999955 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.005404 (+ 5449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:33.005405 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:33.005406 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:33.005413 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:33.008868 (+ 3455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.011343 (+ 2475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.011345 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.011345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.011447 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.011678 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.011680 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.011680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.011823 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:33.011912 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.012485 (+ 573us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.012570 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:13:33.013084 13028 heartbeater.cc:347] Connected to a master server at 127.0.176.254:34377
I20260812 06:13:33.013137 13028 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:33.013187 13051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:32.996915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34750 (local address 127.0.176.252:39477)
0812 06:13:32.997064 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:32.997066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:33.000898 (+ 3832us) server_negotiation.cc:407] Connection header received
0812 06:13:33.001867 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:33.001868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:33.001883 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:33.001956 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:33.002567 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.003874 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.004927 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.005234 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.005293 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.006773 (+ 1480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:33.006774 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:33.006775 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:33.006785 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:33.011722 (+ 4937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.012142 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.012143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.012143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.012205 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.012491 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.012492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.012493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.012636 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:33.012735 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.012987 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.013086 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
I20260812 06:13:33.013211 13028 heartbeater.cc:511] Master 127.0.176.254:34377 requested a full tablet report, sending...
I20260812 06:13:33.013468 10850 ts_manager.cc:194] Re-registered known tserver with Master: eef9430ae97f4fd2b00099aca4e39238 (127.0.176.195:33733)
I20260812 06:13:33.013963 10850 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:54241
I20260812 06:13:33.014405 10850 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60402:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:13:33.016325 10850 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:33.017115 12160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: NON_VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: true } } }
I20260812 06:13:33.017233 12160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:33.018903 11828 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0: attempting to promote NON_VOTER 2d3eb96ec62f4d33b45d52ccf9f02509 to VOTER
I20260812 06:13:33.019081 11828 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } }
I20260812 06:13:33.019490 12240 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 LEARNER]: Refusing update from remote peer 7aacc2f45c92424bb770e47e1c36c4b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 06:13:33.019703 11829 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 06:13:33.020186 11907 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 FOLLOWER]: Refusing update from remote peer 7aacc2f45c92424bb770e47e1c36c4b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 06:13:33.020398 12160 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 06:13:33.020591 11828 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 2d3eb96ec62f4d33b45d52ccf9f02509 (127.0.176.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } } }
I20260812 06:13:33.020830 11907 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 2d3eb96ec62f4d33b45d52ccf9f02509 (127.0.176.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } } }
I20260812 06:13:33.021518 11828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } } }
I20260812 06:13:33.021607 11828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:33.021682 12162 sys_catalog.cc:455] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } } }
I20260812 06:13:33.021775 12162 sys_catalog.cc:458] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:13:33.021533 11829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } } }
I20260812 06:13:33.021922 11829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:33.022028 11828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } } }
I20260812 06:13:33.022113 11828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:33.022101 12240 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 2d3eb96ec62f4d33b45d52ccf9f02509 (127.0.176.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } } }
I20260812 06:13:33.023307 12312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } } }
I20260812 06:13:33.023468 12312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:13:33.027042 13067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.022978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42764 (local address 127.0.176.195:33733)
0812 06:13:33.024059 (+ 1081us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:33.024063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:33.024072 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:33.024112 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:33.024114 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:33.024135 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:33.024202 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:33.024346 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.025114 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.026039 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.026696 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.026793 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.026896 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.026925 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.026963 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1042,"thread_start_us":102,"threads_started":1}
I20260812 06:13:33.027030 11826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.022754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:33733 (local address 127.0.0.1:42764)
0812 06:13:33.022813 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:33.022826 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:33.022867 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:33.024232 (+ 1365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:33.024233 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:33.024235 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:33.024274 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:33.024275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.025230 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.025232 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.025936 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:33.025939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.026790 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.026792 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.026852 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.026856 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:13:33.026904 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:13:33.026949 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 06:13:33.027505 13065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.022870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:45165 (local address 127.0.0.1:60998)
0812 06:13:33.022998 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:33.023010 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:33.023077 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:33.023814 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:33.023816 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:33.023818 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:33.023890 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:33.023892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.024979 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.024981 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.026164 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:33.026167 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.027243 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.027244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.027305 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.027308 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:33.027365 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:13:33.027435 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":82,"threads_started":1}
I20260812 06:13:33.027557 13068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.023111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60998 (local address 127.0.176.193:45165)
0812 06:13:33.023268 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:33.023275 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:33.023286 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:33.023332 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:33.023334 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:33.023353 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:33.023492 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:33.023969 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.024878 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.026423 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.027129 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.027235 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.027308 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.027379 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.027460 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":85,"threads_started":1}
I20260812 06:13:33.028205 12438 tablet_service.cc:1467] Processing CreateTablet for tablet a1ce4c67848e46d6ada2d6267eb9afad (DEFAULT_TABLE table=test-table [id=8616bc0c783a4e71a9910703a965d76b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:33.028628 12438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1ce4c67848e46d6ada2d6267eb9afad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:33.028716 13070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.023472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:39591 (local address 127.0.0.1:36800)
0812 06:13:33.023621 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:33.023631 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:33.023783 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:33.025122 (+ 1339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:33.025123 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:33.025125 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:33.025162 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:33.025163 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.026361 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.026362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.027505 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:33.027508 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.028459 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.028460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.028522 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.028528 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:13:33.028577 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 06:13:33.028621 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":88,"threads_started":1}
I20260812 06:13:33.028981 13071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.023599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36800 (local address 127.0.176.194:39591)
0812 06:13:33.023789 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:33.023794 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:33.023807 (+ 13us) server_negotiation.cc:407] Connection header received
0812 06:13:33.023851 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:33.023853 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:33.023870 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:33.025061 (+ 1191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:33.025237 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.026272 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.027858 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.028341 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.028454 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.028829 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.028862 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.028911 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":103,"threads_started":1}
I20260812 06:13:33.029727 12678 tablet_service.cc:1467] Processing CreateTablet for tablet a1ce4c67848e46d6ada2d6267eb9afad (DEFAULT_TABLE table=test-table [id=8616bc0c783a4e71a9910703a965d76b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:33.030107 12678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1ce4c67848e46d6ada2d6267eb9afad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:33.031898 12917 tablet_service.cc:1467] Processing CreateTablet for tablet a1ce4c67848e46d6ada2d6267eb9afad (DEFAULT_TABLE table=test-table [id=8616bc0c783a4e71a9910703a965d76b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:33.032260 12917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1ce4c67848e46d6ada2d6267eb9afad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:33.032871 13072 tablet_bootstrap.cc:492] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a: Bootstrap starting.
I20260812 06:13:33.033617 13072 tablet_bootstrap.cc:654] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:33.033759 13073 tablet_bootstrap.cc:492] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5: Bootstrap starting.
I20260812 06:13:33.033990 13072 log.cc:824] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:33.034607 13073 tablet_bootstrap.cc:654] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:33.034976 13073 log.cc:824] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:33.035037 13072 tablet_bootstrap.cc:492] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a: No bootstrap required, opened a new log
I20260812 06:13:33.035105 13072 ts_tablet_manager.cc:1397] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:13:33.035808 13073 tablet_bootstrap.cc:492] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5: No bootstrap required, opened a new log
I20260812 06:13:33.035898 13073 ts_tablet_manager.cc:1397] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:13:33.036484 13077 tablet_bootstrap.cc:492] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238: Bootstrap starting.
I20260812 06:13:33.037205 13077 tablet_bootstrap.cc:654] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:33.037556 13077 log.cc:824] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:33.038010 13073 raft_consensus.cc:348] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } }
I20260812 06:13:33.038151 13073 raft_consensus.cc:374] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:33.038174 13073 raft_consensus.cc:729] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2e3abf780e4257951f00b670da4be5, State: Initialized, Role: FOLLOWER
I20260812 06:13:33.038295 13073 consensus_queue.cc:260] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } }
I20260812 06:13:33.038380 13072 raft_consensus.cc:348] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } }
I20260812 06:13:33.038529 13073 ts_tablet_manager.cc:1428] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:13:33.038573 13072 raft_consensus.cc:374] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:33.038640 13072 raft_consensus.cc:729] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45cb20e47f422f8d238e7d6641cb0a, State: Initialized, Role: FOLLOWER
I20260812 06:13:33.038705 12796 heartbeater.cc:503] Master 127.0.176.254:34377 was elected leader, sending a full tablet report...
I20260812 06:13:33.038761 13072 consensus_queue.cc:260] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } }
I20260812 06:13:33.039075 13072 ts_tablet_manager.cc:1428] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260812 06:13:33.039155 12553 heartbeater.cc:503] Master 127.0.176.254:34377 was elected leader, sending a full tablet report...
I20260812 06:13:33.040038 13077 tablet_bootstrap.cc:492] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238: No bootstrap required, opened a new log
I20260812 06:13:33.040115 13077 ts_tablet_manager.cc:1397] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 06:13:33.043758 13077 raft_consensus.cc:348] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } }
I20260812 06:13:33.043947 13077 raft_consensus.cc:374] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:33.043972 13077 raft_consensus.cc:729] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef9430ae97f4fd2b00099aca4e39238, State: Initialized, Role: FOLLOWER
I20260812 06:13:33.044099 13077 consensus_queue.cc:260] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } }
I20260812 06:13:33.044389 13077 ts_tablet_manager.cc:1428] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260812 06:13:33.044463 13028 heartbeater.cc:503] Master 127.0.176.254:34377 was elected leader, sending a full tablet report...
W20260812 06:13:33.074206 12800 tablet.cc:2369] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:13:33.173622 12557 tablet.cc:2369] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:13:33.208128 13089 raft_consensus.cc:482] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:33.208287 13089 raft_consensus.cc:504] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } }
I20260812 06:13:33.208808 13089 leader_election.cc:288] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45cb20e47f422f8d238e7d6641cb0a (127.0.176.193:45165), 5b2e3abf780e4257951f00b670da4be5 (127.0.176.194:39591)
I20260812 06:13:33.212442 13068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.209079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:47263 (local address 127.0.176.193:45165)
0812 06:13:33.209126 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:33.209128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:33.209138 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:33.209170 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:33.209171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:33.209181 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:33.209237 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:33.209449 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.210015 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.211244 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.212007 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.212102 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.212113 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.212316 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.212362 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:13:33.212442 13036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.208985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:45165 (local address 127.0.176.195:47263)
0812 06:13:33.209045 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:33.209059 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:33.209108 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:33.209280 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:33.209281 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:33.209282 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:33.209358 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:33.209360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.210100 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.210101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.211129 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:33.211131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.212149 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.212150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.212235 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.212239 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:13:33.212308 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:13:33.212357 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 06:13:33.212858 12477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ce4c67848e46d6ada2d6267eb9afad" candidate_uuid: "eef9430ae97f4fd2b00099aca4e39238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" is_pre_election: true
I20260812 06:13:33.213012 13038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.209041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:39591 (local address 127.0.176.195:43283)
0812 06:13:33.209147 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:33.209157 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:33.209197 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:33.209829 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:33.209830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:33.209832 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:33.209898 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:33.209900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.210822 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.210823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.211914 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:33.211918 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.212724 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.212726 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:33.212820 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.212824 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:13:33.212890 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 06:13:33.212933 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260812 06:13:33.213080 12477 raft_consensus.cc:2454] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eef9430ae97f4fd2b00099aca4e39238 in term 0.
I20260812 06:13:33.213246 13071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.209605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:43283 (local address 127.0.176.194:39591)
0812 06:13:33.209694 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:33.209696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:33.209705 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:33.209730 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:33.209730 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:33.209738 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:33.209822 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:33.209977 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.210684 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.212028 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.212563 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.212646 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.212657 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.213004 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.213145 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 06:13:33.213353 12837 leader_election.cc:302] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf45cb20e47f422f8d238e7d6641cb0a, eef9430ae97f4fd2b00099aca4e39238; no voters:
I20260812 06:13:33.213522 13089 raft_consensus.cc:2781] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:33.213748 13089 raft_consensus.cc:482] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:33.213837 13089 raft_consensus.cc:3037] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:33.213812 12713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ce4c67848e46d6ada2d6267eb9afad" candidate_uuid: "eef9430ae97f4fd2b00099aca4e39238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2e3abf780e4257951f00b670da4be5" is_pre_election: true
I20260812 06:13:33.214020 12713 raft_consensus.cc:2454] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eef9430ae97f4fd2b00099aca4e39238 in term 0.
I20260812 06:13:33.215070 13089 raft_consensus.cc:504] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } }
I20260812 06:13:33.215248 13089 leader_election.cc:288] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [CANDIDATE]: Term 1 election: Requested vote from peers cf45cb20e47f422f8d238e7d6641cb0a (127.0.176.193:45165), 5b2e3abf780e4257951f00b670da4be5 (127.0.176.194:39591)
I20260812 06:13:33.215459 12477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ce4c67848e46d6ada2d6267eb9afad" candidate_uuid: "eef9430ae97f4fd2b00099aca4e39238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45cb20e47f422f8d238e7d6641cb0a"
I20260812 06:13:33.215481 12713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ce4c67848e46d6ada2d6267eb9afad" candidate_uuid: "eef9430ae97f4fd2b00099aca4e39238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2e3abf780e4257951f00b670da4be5"
I20260812 06:13:33.215554 12477 raft_consensus.cc:3037] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:33.215612 12713 raft_consensus.cc:3037] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:33.216380 12713 raft_consensus.cc:2454] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eef9430ae97f4fd2b00099aca4e39238 in term 1.
I20260812 06:13:33.216483 12477 raft_consensus.cc:2454] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eef9430ae97f4fd2b00099aca4e39238 in term 1.
I20260812 06:13:33.216571 12832 leader_election.cc:302] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2e3abf780e4257951f00b670da4be5, eef9430ae97f4fd2b00099aca4e39238; no voters:
I20260812 06:13:33.216701 13089 raft_consensus.cc:2781] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:33.216921 13089 raft_consensus.cc:686] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [term 1 LEADER]: Becoming Leader. State: Replica: eef9430ae97f4fd2b00099aca4e39238, State: Running, Role: LEADER
I20260812 06:13:33.217048 13089 consensus_queue.cc:237] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } }
I20260812 06:13:33.217976 10849 catalog_manager.cc:5495] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 reported cstate change: term changed from 0 to 1, leader changed from <none> to eef9430ae97f4fd2b00099aca4e39238 (127.0.176.195). New cstate: current_term: 1 leader_uuid: "eef9430ae97f4fd2b00099aca4e39238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } health_report { overall_health: UNKNOWN } } }
W20260812 06:13:33.243906 13033 tablet.cc:2369] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:13:33.263338 13067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.260223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42774 (local address 127.0.176.195:33733)
0812 06:13:33.260293 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:33.260295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:33.260305 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:33.260354 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:33.260355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:33.260373 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:33.260475 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:33.260660 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.261474 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.262313 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.262527 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.262738 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.262970 (+ 232us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:33.263091 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:33.263193 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.263213 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.263242 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 06:13:33.266049 12713 raft_consensus.cc:1261] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5 [term 1 FOLLOWER]: Refusing update from remote peer eef9430ae97f4fd2b00099aca4e39238: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:33.266049 12477 raft_consensus.cc:1261] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a [term 1 FOLLOWER]: Refusing update from remote peer eef9430ae97f4fd2b00099aca4e39238: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:33.266541 13089 consensus_queue.cc:1035] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:33.266736 13090 consensus_queue.cc:1035] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:33.270854 13101 mvcc.cc:205] Tried to move back new op lower bound from 7317566313534021632 to 7317566313337704448. Current Snapshot: MvccSnapshot[applied={T|T < 7317566313534021632}]
I20260812 06:13:33.272104 13100 mvcc.cc:205] Tried to move back new op lower bound from 7317566313534021632 to 7317566313337704448. Current Snapshot: MvccSnapshot[applied={T|T < 7317566313534021632}]
I20260812 06:13:33.273618 10850 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:33.273741 10850 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:33.275729 10850 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7aacc2f45c92424bb770e47e1c36c4b0: Sending DeleteTablet for 3 replicas of tablet a1ce4c67848e46d6ada2d6267eb9afad
I20260812 06:13:33.276177 12438 tablet_service.cc:1514] Processing DeleteTablet for tablet a1ce4c67848e46d6ada2d6267eb9afad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:33 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:60998
I20260812 06:13:33.276190 12678 tablet_service.cc:1514] Processing DeleteTablet for tablet a1ce4c67848e46d6ada2d6267eb9afad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:33 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:36800
I20260812 06:13:33.276490 12917 tablet_service.cc:1514] Processing DeleteTablet for tablet a1ce4c67848e46d6ada2d6267eb9afad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:33 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:42764
I20260812 06:13:33.276729 13120 tablet_replica.cc:330] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238: stopping tablet replica
I20260812 06:13:33.276832 13120 raft_consensus.cc:2229] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:13:33.276937 13120 raft_consensus.cc:2258] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:33.277067 13115 tablet_replica.cc:330] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5: stopping tablet replica
I20260812 06:13:33.277237 13115 raft_consensus.cc:2229] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:33.277408 13115 raft_consensus.cc:2258] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:33.277470 13120 ts_tablet_manager.cc:1905] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:33.277559 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 10793
I20260812 06:13:33.278064 13115 ts_tablet_manager.cc:1905] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:33.279247 13120 ts_tablet_manager.cc:1918] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:33.279345 13120 log.cc:1196] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/a1ce4c67848e46d6ada2d6267eb9afad
I20260812 06:13:33.279687 13120 ts_tablet_manager.cc:1939] T a1ce4c67848e46d6ada2d6267eb9afad P eef9430ae97f4fd2b00099aca4e39238: Deleting consensus metadata
I20260812 06:13:33.280771 13115 ts_tablet_manager.cc:1918] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:33.280972 13115 log.cc:1196] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/a1ce4c67848e46d6ada2d6267eb9afad
I20260812 06:13:33.281402 13115 ts_tablet_manager.cc:1939] T a1ce4c67848e46d6ada2d6267eb9afad P 5b2e3abf780e4257951f00b670da4be5: Deleting consensus metadata
I20260812 06:13:33.290841 13112 tablet_replica.cc:330] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a: stopping tablet replica
I20260812 06:13:33.291044 13112 raft_consensus.cc:2229] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:33.291194 13112 raft_consensus.cc:2258] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:33.293387 13112 ts_tablet_manager.cc:1905] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:33.295336 13112 ts_tablet_manager.cc:1918] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:33.295490 13112 log.cc:1196] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-0/wal/wals/a1ce4c67848e46d6ada2d6267eb9afad
I20260812 06:13:33.295776 13112 ts_tablet_manager.cc:1939] T a1ce4c67848e46d6ada2d6267eb9afad P cf45cb20e47f422f8d238e7d6641cb0a: Deleting consensus metadata
W20260812 06:13:33.301173 12596 connection.cc:535] server connection from 127.0.0.1:36800 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:13:33.301174 12359 connection.cc:535] server connection from 127.0.0.1:60998 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:13:33.301353 13051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.276708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34758 (local address 127.0.176.252:39477)
0812 06:13:33.276753 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:33.276755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:33.290582 (+ 13827us) server_negotiation.cc:407] Connection header received
0812 06:13:33.290632 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:33.290633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:33.290650 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:33.290730 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:33.292146 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.293057 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.294298 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.294658 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.294706 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.296992 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:33.296994 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:33.296994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:33.297003 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:33.299540 (+ 2537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.300343 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.300345 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.300346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.300416 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.300659 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.300660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.300661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.300828 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:33.300922 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.301151 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.301264 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 06:13:33.301581 12833 connection.cc:535] server connection from 127.0.0.1:42764 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:13:33.312072 13050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.303360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58176 (local address 127.0.176.253:39533)
0812 06:13:33.303535 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:33.303538 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:33.303866 (+ 328us) server_negotiation.cc:407] Connection header received
0812 06:13:33.303939 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:33.303940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:33.303959 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:33.304016 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:33.305296 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.305840 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.306645 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.306872 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.306954 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.308462 (+ 1508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:33.308463 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:33.308463 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:33.308472 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:33.310669 (+ 2197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.311100 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.311102 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.311102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.311186 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.311455 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.311456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.311457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.311617 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:33.311731 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.311843 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.311941 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260812 06:13:33.312333 13051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:33.303559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34770 (local address 127.0.176.252:39477)
0812 06:13:33.303682 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:33.303685 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:33.304017 (+ 332us) server_negotiation.cc:407] Connection header received
0812 06:13:33.304101 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:33.304102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:33.304114 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:33.304254 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:33.304777 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.305345 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.306663 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:33.306985 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:33.307030 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:33.308745 (+ 1715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:33.308746 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:33.308747 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:33.308755 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:33.310683 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.311213 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.311215 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.311215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.311274 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:33.311536 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:33.311538 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:33.311538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:33.311690 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:33.311788 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:33.311995 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 06:13:33.312088 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:13:34.272269 13131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.271945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.193:41419)
0812 06:13:34.272101 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:34.272205 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":99,"threads_started":1}
I20260812 06:13:34.272352 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.271969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.195:38449)
0812 06:13:34.272210 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:34.272296 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":67,"threads_started":1}
W20260812 06:13:34.272603 12553 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:34377 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
W20260812 06:13:34.272701 13028 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:34377 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
I20260812 06:13:34.272979 13133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.272706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.194:58071)
0812 06:13:34.272838 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:34.272932 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":51,"threads_started":1}
W20260812 06:13:34.273149 12796 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:34377 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
I20260812 06:13:34.776357 13134 raft_consensus.cc:482] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7aacc2f45c92424bb770e47e1c36c4b0)
I20260812 06:13:34.776528 13134 raft_consensus.cc:504] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } }
I20260812 06:13:34.776547 13135 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7aacc2f45c92424bb770e47e1c36c4b0)
I20260812 06:13:34.776733 13135 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } }
I20260812 06:13:34.776887 13134 leader_election.cc:288] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7aacc2f45c92424bb770e47e1c36c4b0 (127.0.176.254:34377), 2d3eb96ec62f4d33b45d52ccf9f02509 (127.0.176.252:39477)
I20260812 06:13:34.777029 13135 leader_election.cc:288] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7aacc2f45c92424bb770e47e1c36c4b0 (127.0.176.254:34377), f73ddc1404ea49a497de5f3e4f199385 (127.0.176.253:39533)
I20260812 06:13:34.777412 13139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.777168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35100)
0812 06:13:34.777309 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:34.777365 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":57,"threads_started":1}
I20260812 06:13:34.777513 13138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.777055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35098)
0812 06:13:34.777409 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:34.777464 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":60,"threads_started":1}
W20260812 06:13:34.777535 12203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
W20260812 06:13:34.777652 11866 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
I20260812 06:13:34.777988 13139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.777888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35114)
0812 06:13:34.777927 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:34.777954 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 06:13:34.778091 13138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.778005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35118)
0812 06:13:34.778041 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:34.778067 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 06:13:34.778090 12203 leader_election.cc:334] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7aacc2f45c92424bb770e47e1c36c4b0 (127.0.176.254:34377): Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
W20260812 06:13:34.778177 11866 leader_election.cc:334] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7aacc2f45c92424bb770e47e1c36c4b0 (127.0.176.254:34377): Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
I20260812 06:13:34.780941 13140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.777195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:39533 (local address 127.0.0.1:50938)
0812 06:13:34.777438 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:34.777449 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:34.777511 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:34.777785 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:34.777786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:34.777789 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:34.777858 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:34.777860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:34.778711 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:34.778712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:34.779989 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:34.779993 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:34.780672 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:34.780673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:34.780735 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:34.780738 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:34.780799 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:13:34.780837 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":73,"threads_started":1}
I20260812 06:13:34.780951 13142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.777331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50938 (local address 127.0.176.253:39533)
0812 06:13:34.777604 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:34.777606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:34.777613 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:13:34.777641 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:34.777642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:34.777654 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:34.777723 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:34.777949 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:34.778608 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:34.780113 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:34.780556 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:34.780657 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:34.780669 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:34.780818 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 06:13:34.780875 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":47,"threads_started":1}
I20260812 06:13:34.781213 13141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.777250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39477 (local address 127.0.0.1:52806)
0812 06:13:34.777651 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:34.777666 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:34.777808 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:34.778271 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:34.778272 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:34.778274 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:34.778342 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:34.778344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:34.778992 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:34.778993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:34.780167 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:34.780170 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:34.780732 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:34.780733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:34.780818 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:34.780823 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:13:34.780879 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 06:13:34.780917 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":48,"threads_started":1}
I20260812 06:13:34.781037 13144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.777388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52806 (local address 127.0.176.252:39477)
0812 06:13:34.777922 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:34.777924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:34.777932 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:13:34.777955 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:34.777956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:34.777965 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:34.778406 (+ 441us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:34.778436 (+ 30us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:34.778900 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:34.780261 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:34.780662 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:34.780731 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:34.780741 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:34.780897 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 06:13:34.780938 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":46,"threads_started":1}
I20260812 06:13:34.781304 11907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f73ddc1404ea49a497de5f3e4f199385" is_pre_election: true
I20260812 06:13:34.781473 11907 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3eb96ec62f4d33b45d52ccf9f02509 in term 1.
I20260812 06:13:34.781586 12240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f73ddc1404ea49a497de5f3e4f199385" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" is_pre_election: true
I20260812 06:13:34.781695 12240 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f73ddc1404ea49a497de5f3e4f199385 in term 1.
I20260812 06:13:34.781656 12202 leader_election.cc:302] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3eb96ec62f4d33b45d52ccf9f02509, f73ddc1404ea49a497de5f3e4f199385; no voters: 7aacc2f45c92424bb770e47e1c36c4b0
I20260812 06:13:34.781785 13135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:13:34.781831 13135 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7aacc2f45c92424bb770e47e1c36c4b0)
I20260812 06:13:34.781862 13135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:13:34.781852 11866 leader_election.cc:302] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3eb96ec62f4d33b45d52ccf9f02509, f73ddc1404ea49a497de5f3e4f199385; no voters: 7aacc2f45c92424bb770e47e1c36c4b0
I20260812 06:13:34.781951 13134 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:13:34.782001 13134 raft_consensus.cc:482] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7aacc2f45c92424bb770e47e1c36c4b0)
I20260812 06:13:34.782027 13134 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:13:34.782857 13134 raft_consensus.cc:504] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } }
I20260812 06:13:34.782857 13135 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } }
I20260812 06:13:34.783007 13134 leader_election.cc:288] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [CANDIDATE]: Term 2 election: Requested vote from peers 7aacc2f45c92424bb770e47e1c36c4b0 (127.0.176.254:34377), 2d3eb96ec62f4d33b45d52ccf9f02509 (127.0.176.252:39477)
I20260812 06:13:34.783017 13135 leader_election.cc:288] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [CANDIDATE]: Term 2 election: Requested vote from peers 7aacc2f45c92424bb770e47e1c36c4b0 (127.0.176.254:34377), f73ddc1404ea49a497de5f3e4f199385 (127.0.176.253:39533)
I20260812 06:13:34.783237 13141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.783107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35126)
0812 06:13:34.783171 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:34.783206 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 06:13:34.783234 11907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f73ddc1404ea49a497de5f3e4f199385"
I20260812 06:13:34.783246 12240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f73ddc1404ea49a497de5f3e4f199385" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509"
I20260812 06:13:34.783330 11907 raft_consensus.cc:2379] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d3eb96ec62f4d33b45d52ccf9f02509 in current term 2: Already voted for candidate f73ddc1404ea49a497de5f3e4f199385 in this term.
I20260812 06:13:34.783331 12240 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f73ddc1404ea49a497de5f3e4f199385 in current term 2: Already voted for candidate 2d3eb96ec62f4d33b45d52ccf9f02509 in this term.
I20260812 06:13:34.783654 13141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.783566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35154)
0812 06:13:34.783599 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:34.783627 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260812 06:13:34.783725 11866 leader_election.cc:334] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7aacc2f45c92424bb770e47e1c36c4b0 (127.0.176.254:34377): Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
I20260812 06:13:34.783772 11866 leader_election.cc:302] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f73ddc1404ea49a497de5f3e4f199385; no voters: 2d3eb96ec62f4d33b45d52ccf9f02509, 7aacc2f45c92424bb770e47e1c36c4b0
I20260812 06:13:34.783668 13140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.783164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35142)
0812 06:13:34.783281 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:34.783374 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260812 06:13:34.783855 13134 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 06:13:34.784176 13140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:34.784091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35158)
0812 06:13:34.784134 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:34.784160 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 06:13:34.784245 12203 leader_election.cc:334] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7aacc2f45c92424bb770e47e1c36c4b0 (127.0.176.254:34377): Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
I20260812 06:13:34.784307 12203 leader_election.cc:302] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d3eb96ec62f4d33b45d52ccf9f02509; no voters: 7aacc2f45c92424bb770e47e1c36c4b0, f73ddc1404ea49a497de5f3e4f199385
I20260812 06:13:34.784385 13135 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 06:13:35.273264 13149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:35.272980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.193:44883)
0812 06:13:35.273151 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:35.273194 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":97,"threads_started":1}
I20260812 06:13:35.273607 13151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:35.272988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.195:57335)
0812 06:13:35.273189 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:35.273505 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":87,"threads_started":1}
I20260812 06:13:35.273948 13152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:35.273549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.194:58985)
0812 06:13:35.273831 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:35.273894 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":73,"threads_started":1}
I20260812 06:13:36.274741 13158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.274373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.195:48451)
0812 06:13:36.274526 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.274678 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":71,"threads_started":1}
I20260812 06:13:36.275025 13160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.274574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.193:43685)
0812 06:13:36.274934 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.274975 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":64,"threads_started":1}
I20260812 06:13:36.275206 13159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.274471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.194:32873)
0812 06:13:36.275119 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.275157 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":52,"threads_started":1}
I20260812 06:13:36.518009 13162 raft_consensus.cc:482] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:36.518122 13162 raft_consensus.cc:504] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } }
I20260812 06:13:36.518357 13162 leader_election.cc:288] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7aacc2f45c92424bb770e47e1c36c4b0 (127.0.176.254:34377), 2d3eb96ec62f4d33b45d52ccf9f02509 (127.0.176.252:39477)
I20260812 06:13:36.518787 13164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.518548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35396)
0812 06:13:36.518685 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.518732 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
I20260812 06:13:36.518904 12240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f73ddc1404ea49a497de5f3e4f199385" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" is_pre_election: true
I20260812 06:13:36.519068 12240 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f73ddc1404ea49a497de5f3e4f199385 in term 2.
I20260812 06:13:36.519241 13164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.519148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35410)
0812 06:13:36.519185 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.519217 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260812 06:13:36.519246 11866 leader_election.cc:302] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3eb96ec62f4d33b45d52ccf9f02509, f73ddc1404ea49a497de5f3e4f199385; no voters:
W20260812 06:13:36.519413 11866 leader_election.cc:334] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7aacc2f45c92424bb770e47e1c36c4b0 (127.0.176.254:34377): Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
I20260812 06:13:36.519425 13162 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 06:13:36.519464 13162 raft_consensus.cc:482] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:36.519496 13162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:13:36.520362 13162 raft_consensus.cc:504] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } }
I20260812 06:13:36.520529 13162 leader_election.cc:288] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [CANDIDATE]: Term 3 election: Requested vote from peers 7aacc2f45c92424bb770e47e1c36c4b0 (127.0.176.254:34377), 2d3eb96ec62f4d33b45d52ccf9f02509 (127.0.176.252:39477)
I20260812 06:13:36.520851 13164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.520698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35414)
0812 06:13:36.520782 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.520819 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 06:13:36.520963 12240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f73ddc1404ea49a497de5f3e4f199385" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509"
I20260812 06:13:36.521078 12240 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:13:36.521287 13164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.521199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35420)
0812 06:13:36.521246 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.521271 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260812 06:13:36.521389 11866 leader_election.cc:334] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7aacc2f45c92424bb770e47e1c36c4b0 (127.0.176.254:34377): Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
I20260812 06:13:36.522022 12240 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f73ddc1404ea49a497de5f3e4f199385 in term 3.
I20260812 06:13:36.522234 11866 leader_election.cc:302] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3eb96ec62f4d33b45d52ccf9f02509, f73ddc1404ea49a497de5f3e4f199385; no voters: 7aacc2f45c92424bb770e47e1c36c4b0
I20260812 06:13:36.522346 13162 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:13:36.522492 13162 raft_consensus.cc:686] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [term 3 LEADER]: Becoming Leader. State: Replica: f73ddc1404ea49a497de5f3e4f199385, State: Running, Role: LEADER
I20260812 06:13:36.522578 13162 consensus_queue.cc:237] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } }
I20260812 06:13:36.523002 13167 sys_catalog.cc:455] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f73ddc1404ea49a497de5f3e4f199385. Latest consensus state: current_term: 3 leader_uuid: "f73ddc1404ea49a497de5f3e4f199385" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } } }
I20260812 06:13:36.523115 13167 sys_catalog.cc:458] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:36.523365 13170 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:36.523962 13170 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:36.524034 13170 catalog_manager.cc:1259] Loaded cluster ID: 18f656aed3714ee093cd4c132e7bd524
I20260812 06:13:36.524050 13170 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:36.524300 13170 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:36.524399 13170 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: Loaded TSK: 0
I20260812 06:13:36.524559 13170 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:13:36.565441 11889 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:13:36.567049 11889 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:36.568573 13164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.568451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35440)
0812 06:13:36.568506 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.568544 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 06:13:36.568583 12240 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [term 3 FOLLOWER]: Refusing update from remote peer f73ddc1404ea49a497de5f3e4f199385: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260812 06:13:36.568835 13167 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 06:13:36.569018 13164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.568885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.0.1:35454)
0812 06:13:36.568938 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.568985 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 06:13:36.569114 11866 consensus_peers.cc:487] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 -> Peer 7aacc2f45c92424bb770e47e1c36c4b0 (127.0.176.254:34377): Couldn't send request to peer 7aacc2f45c92424bb770e47e1c36c4b0. Status: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:13:36.569541 13174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f73ddc1404ea49a497de5f3e4f199385. Latest consensus state: current_term: 3 leader_uuid: "f73ddc1404ea49a497de5f3e4f199385" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } } }
I20260812 06:13:36.569658 13174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:13:36.570103 13171 mvcc.cc:205] Tried to move back new op lower bound from 7317566327061192704 to 7317566326877130752. Current Snapshot: MvccSnapshot[applied={T|T < 7317566327061192704}]
I20260812 06:13:36.570288 13167 sys_catalog.cc:455] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "f73ddc1404ea49a497de5f3e4f199385" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } } }
I20260812 06:13:36.570408 13167 sys_catalog.cc:458] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:36.570863 13174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "f73ddc1404ea49a497de5f3e4f199385" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "7aacc2f45c92424bb770e47e1c36c4b0" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 34377 } } peers { permanent_uuid: "f73ddc1404ea49a497de5f3e4f199385" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 39533 } attrs { promote: false } } peers { permanent_uuid: "2d3eb96ec62f4d33b45d52ccf9f02509" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39477 } attrs { promote: false } } }
I20260812 06:13:36.570948 13174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3eb96ec62f4d33b45d52ccf9f02509 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:13:36.576294 13190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.572550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:45165 (local address 127.0.0.1:42036)
0812 06:13:36.572727 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.572738 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:36.572789 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:36.573214 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:36.573215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:36.573217 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:36.573281 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:36.573283 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.574261 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.574261 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:36.575367 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:36.575369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.575997 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.575998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:36.576076 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:36.576082 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:13:36.576154 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:13:36.576197 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":129,"threads_started":1}
I20260812 06:13:36.576370 13183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.572539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48688 (local address 127.0.176.194:39591)
0812 06:13:36.573120 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:36.573122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:36.573133 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:36.573159 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:36.573160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:36.573170 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:36.573396 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:36.573437 (+ 41us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.574144 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.575505 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.576077 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.576139 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:36.576148 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:36.576280 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 06:13:36.576314 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":66,"threads_started":1}
I20260812 06:13:36.576476 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.572987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42036 (local address 127.0.176.193:45165)
0812 06:13:36.573103 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:36.573105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:36.573113 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:13:36.573140 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:36.573140 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:36.573151 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:36.573211 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:36.573360 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.574182 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.575501 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.575888 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.575993 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:36.576006 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:36.576330 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 06:13:36.576390 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":57,"threads_started":1}
I20260812 06:13:36.576709 12438 tablet_service.cc:1467] Processing CreateTablet for tablet 620bc77da593422fb05e9d3f3324d309 (DEFAULT_TABLE table=test-table [id=baa254c268b343efb5e6fb4a0f4e7351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:36.576850 12438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 620bc77da593422fb05e9d3f3324d309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:36.577061 13164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.572433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:39591 (local address 127.0.0.1:48688)
0812 06:13:36.572536 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.572548 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:36.572614 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:36.573285 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:36.573286 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:36.573288 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:36.573321 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:36.573322 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.574245 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.574246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:36.575382 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:36.575384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.576155 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.576155 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:36.576208 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:36.576211 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:36.576265 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:13:36.576295 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":56}
I20260812 06:13:36.577275 12678 tablet_service.cc:1467] Processing CreateTablet for tablet 620bc77da593422fb05e9d3f3324d309 (DEFAULT_TABLE table=test-table [id=baa254c268b343efb5e6fb4a0f4e7351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:36.577363 13191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.572798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:33733 (local address 127.0.0.1:59104)
0812 06:13:36.572922 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.572932 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:36.572978 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:36.573150 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:36.573151 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:36.573154 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:36.573223 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:36.573225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.573997 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.573998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:36.575196 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:36.575199 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.577140 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.577141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:36.577199 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:36.577202 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:36.577265 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 06:13:36.577309 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":86,"threads_started":1}
I20260812 06:13:36.577414 12678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 620bc77da593422fb05e9d3f3324d309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:36.577414 13192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.572873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59104 (local address 127.0.176.195:33733)
0812 06:13:36.572994 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:36.572997 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:36.573005 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:13:36.573032 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:36.573033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:36.573043 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:36.573127 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:36.573325 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.573898 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.575281 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.575895 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.575995 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:36.576007 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:36.577271 (+ 1264us) server_negotiation.cc:299] Negotiation successful
0812 06:13:36.577329 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":55,"threads_started":1}
I20260812 06:13:36.578245 13195 tablet_bootstrap.cc:492] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a: Bootstrap starting.
I20260812 06:13:36.578629 13197 tablet_bootstrap.cc:492] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5: Bootstrap starting.
I20260812 06:13:36.578768 13195 tablet_bootstrap.cc:654] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:36.578946 12917 tablet_service.cc:1467] Processing CreateTablet for tablet 620bc77da593422fb05e9d3f3324d309 (DEFAULT_TABLE table=test-table [id=baa254c268b343efb5e6fb4a0f4e7351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:36.579105 12917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 620bc77da593422fb05e9d3f3324d309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:36.579118 13197 tablet_bootstrap.cc:654] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:36.579761 13197 tablet_bootstrap.cc:492] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5: No bootstrap required, opened a new log
I20260812 06:13:36.579818 13195 tablet_bootstrap.cc:492] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a: No bootstrap required, opened a new log
I20260812 06:13:36.579838 13197 ts_tablet_manager.cc:1397] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:36.579888 13195 ts_tablet_manager.cc:1397] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:13:36.580014 13197 raft_consensus.cc:348] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } }
I20260812 06:13:36.580070 13197 raft_consensus.cc:374] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:36.580083 13197 raft_consensus.cc:729] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2e3abf780e4257951f00b670da4be5, State: Initialized, Role: FOLLOWER
I20260812 06:13:36.580047 13195 raft_consensus.cc:348] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } }
I20260812 06:13:36.580133 13195 raft_consensus.cc:374] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:36.580157 13195 raft_consensus.cc:729] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45cb20e47f422f8d238e7d6641cb0a, State: Initialized, Role: FOLLOWER
I20260812 06:13:36.580145 13197 consensus_queue.cc:260] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } }
I20260812 06:13:36.580209 13195 consensus_queue.cc:260] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } }
I20260812 06:13:36.580343 13197 ts_tablet_manager.cc:1428] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 06:13:36.580394 13195 ts_tablet_manager.cc:1428] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:36.580960 13160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.580735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.193:40305)
0812 06:13:36.580874 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.580910 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260812 06:13:36.581141 13159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.580580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.194:57739)
0812 06:13:36.581073 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.581111 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472}
I20260812 06:13:36.581480 13159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.581387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.194:42483)
0812 06:13:36.581428 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.581451 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 06:13:36.581616 12799 heartbeater.cc:503] Master 127.0.176.253:39533 was elected leader, sending a full tablet report...
I20260812 06:13:36.581852 13211 tablet_bootstrap.cc:492] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238: Bootstrap starting.
I20260812 06:13:36.581954 12554 heartbeater.cc:503] Master 127.0.176.253:39533 was elected leader, sending a full tablet report...
I20260812 06:13:36.582020 13160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.581924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.193:60903)
0812 06:13:36.581974 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.582000 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 06:13:36.582371 13211 tablet_bootstrap.cc:654] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:36.583050 13211 tablet_bootstrap.cc:492] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238: No bootstrap required, opened a new log
I20260812 06:13:36.583097 13211 ts_tablet_manager.cc:1397] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:36.583225 13211 raft_consensus.cc:348] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } }
I20260812 06:13:36.583309 13211 raft_consensus.cc:374] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:36.583353 13211 raft_consensus.cc:729] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef9430ae97f4fd2b00099aca4e39238, State: Initialized, Role: FOLLOWER
I20260812 06:13:36.583449 13211 consensus_queue.cc:260] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } }
I20260812 06:13:36.583633 13211 ts_tablet_manager.cc:1428] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:36.584082 13158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.583935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.195:37263)
0812 06:13:36.584020 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.584056 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 06:13:36.584199 13030 heartbeater.cc:503] Master 127.0.176.253:39533 was elected leader, sending a full tablet report...
I20260812 06:13:36.827512 13213 raft_consensus.cc:482] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:36.827641 13213 raft_consensus.cc:504] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } }
I20260812 06:13:36.827865 13213 leader_election.cc:288] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b2e3abf780e4257951f00b670da4be5 (127.0.176.194:39591), cf45cb20e47f422f8d238e7d6641cb0a (127.0.176.193:45165)
I20260812 06:13:36.828147 12713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620bc77da593422fb05e9d3f3324d309" candidate_uuid: "eef9430ae97f4fd2b00099aca4e39238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2e3abf780e4257951f00b670da4be5" is_pre_election: true
I20260812 06:13:36.828158 12477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620bc77da593422fb05e9d3f3324d309" candidate_uuid: "eef9430ae97f4fd2b00099aca4e39238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" is_pre_election: true
I20260812 06:13:36.828269 12477 raft_consensus.cc:2454] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eef9430ae97f4fd2b00099aca4e39238 in term 0.
I20260812 06:13:36.828272 12713 raft_consensus.cc:2454] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eef9430ae97f4fd2b00099aca4e39238 in term 0.
I20260812 06:13:36.828477 12832 leader_election.cc:302] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2e3abf780e4257951f00b670da4be5, eef9430ae97f4fd2b00099aca4e39238; no voters:
I20260812 06:13:36.828627 13213 raft_consensus.cc:2781] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:36.828678 13213 raft_consensus.cc:482] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:36.828693 13213 raft_consensus.cc:3037] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:36.829438 13213 raft_consensus.cc:504] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } }
I20260812 06:13:36.829654 13213 leader_election.cc:288] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [CANDIDATE]: Term 1 election: Requested vote from peers 5b2e3abf780e4257951f00b670da4be5 (127.0.176.194:39591), cf45cb20e47f422f8d238e7d6641cb0a (127.0.176.193:45165)
I20260812 06:13:36.829782 12713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620bc77da593422fb05e9d3f3324d309" candidate_uuid: "eef9430ae97f4fd2b00099aca4e39238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2e3abf780e4257951f00b670da4be5"
I20260812 06:13:36.829872 12713 raft_consensus.cc:3037] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:36.829836 12477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620bc77da593422fb05e9d3f3324d309" candidate_uuid: "eef9430ae97f4fd2b00099aca4e39238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45cb20e47f422f8d238e7d6641cb0a"
I20260812 06:13:36.829952 12477 raft_consensus.cc:3037] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:36.830554 12477 raft_consensus.cc:2454] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eef9430ae97f4fd2b00099aca4e39238 in term 1.
I20260812 06:13:36.830582 12713 raft_consensus.cc:2454] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eef9430ae97f4fd2b00099aca4e39238 in term 1.
I20260812 06:13:36.830802 12837 leader_election.cc:302] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf45cb20e47f422f8d238e7d6641cb0a, eef9430ae97f4fd2b00099aca4e39238; no voters:
I20260812 06:13:36.830927 13213 raft_consensus.cc:2781] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:36.831118 13213 raft_consensus.cc:686] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [term 1 LEADER]: Becoming Leader. State: Replica: eef9430ae97f4fd2b00099aca4e39238, State: Running, Role: LEADER
I20260812 06:13:36.831264 13213 consensus_queue.cc:237] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } } peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } }
I20260812 06:13:36.831624 13158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.831490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.195:39849)
0812 06:13:36.831540 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.831575 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:13:36.832000 11889 catalog_manager.cc:5495] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 reported cstate change: term changed from 0 to 1, leader changed from <none> to eef9430ae97f4fd2b00099aca4e39238 (127.0.176.195). New cstate: current_term: 1 leader_uuid: "eef9430ae97f4fd2b00099aca4e39238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eef9430ae97f4fd2b00099aca4e39238" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 33733 } health_report { overall_health: HEALTHY } } }
I20260812 06:13:36.863421 13192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.861056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59114 (local address 127.0.176.195:33733)
0812 06:13:36.861138 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:36.861140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:36.861148 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:13:36.861170 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:36.861171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:36.861180 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:36.861246 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:36.861407 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.861908 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.862679 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:36.862899 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:36.862978 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:36.863123 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:36.863159 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:36.863212 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:36.863276 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 06:13:36.863302 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 06:13:36.864477 12713 raft_consensus.cc:1261] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5 [term 1 FOLLOWER]: Refusing update from remote peer eef9430ae97f4fd2b00099aca4e39238: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:36.864480 12477 raft_consensus.cc:1261] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a [term 1 FOLLOWER]: Refusing update from remote peer eef9430ae97f4fd2b00099aca4e39238: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:36.864699 13213 consensus_queue.cc:1035] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2e3abf780e4257951f00b670da4be5" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:36.864794 13214 consensus_queue.cc:1035] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45cb20e47f422f8d238e7d6641cb0a" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 45165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:36.865738 13159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.865511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.194:36459)
0812 06:13:36.865662 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.865699 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260812 06:13:36.865978 13160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.865538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.193:58857)
0812 06:13:36.865905 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.865942 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350}
I20260812 06:13:36.866164 13219 mvcc.cc:205] Tried to move back new op lower bound from 7317566328274919424 to 7317566328141500416. Current Snapshot: MvccSnapshot[applied={T|T < 7317566328274919424}]
I20260812 06:13:36.866531 13158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.866435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.195:60563)
0812 06:13:36.866475 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.866504 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 06:13:36.867203 13159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.866951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.194:53541)
0812 06:13:36.867141 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.867172 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172}
I20260812 06:13:36.868631 11888 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:36.868742 13158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.868286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.195:34299)
0812 06:13:36.868647 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.868686 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340}
I20260812 06:13:36.868747 11888 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:36.869165 13160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.869036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:34377 (local address 127.0.176.193:58135)
0812 06:13:36.869081 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.869125 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:34377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 06:13:36.870267 11888 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f73ddc1404ea49a497de5f3e4f199385: Sending DeleteTablet for 3 replicas of tablet 620bc77da593422fb05e9d3f3324d309
I20260812 06:13:36.870625 12438 tablet_service.cc:1514] Processing DeleteTablet for tablet 620bc77da593422fb05e9d3f3324d309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:36 UTC) from {username='oryx', principal='oryx/127.0.176.253@KRBTEST.COM'} at 127.0.0.1:42036
I20260812 06:13:36.870642 12678 tablet_service.cc:1514] Processing DeleteTablet for tablet 620bc77da593422fb05e9d3f3324d309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:36 UTC) from {username='oryx', principal='oryx/127.0.176.253@KRBTEST.COM'} at 127.0.0.1:48688
I20260812 06:13:36.870632 12917 tablet_service.cc:1514] Processing DeleteTablet for tablet 620bc77da593422fb05e9d3f3324d309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:36 UTC) from {username='oryx', principal='oryx/127.0.176.253@KRBTEST.COM'} at 127.0.0.1:59104
I20260812 06:13:36.870893 13233 tablet_replica.cc:330] T 620bc77da593422fb05e9d3f3324d309 P cf45cb20e47f422f8d238e7d6641cb0a: stopping tablet replica
I20260812 06:13:36.870980 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 12154
I20260812 06:13:36.871025 13234 tablet_replica.cc:330] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5: stopping tablet replica
I20260812 06:13:36.874580 13234 raft_consensus.cc:2229] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:36.874673 13234 raft_consensus.cc:2258] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:36.876911 13236 tablet_replica.cc:330] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238: stopping tablet replica
I20260812 06:13:36.877014 13236 raft_consensus.cc:2229] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:13:36.877103 13236 raft_consensus.cc:2258] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:36.879031 13236 ts_tablet_manager.cc:1905] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:36.880606 13236 ts_tablet_manager.cc:1918] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:36.880645 13234 ts_tablet_manager.cc:1905] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:36.880751 13236 log.cc:1196] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/620bc77da593422fb05e9d3f3324d309
I20260812 06:13:36.881140 13236 ts_tablet_manager.cc:1939] T 620bc77da593422fb05e9d3f3324d309 P eef9430ae97f4fd2b00099aca4e39238: Deleting consensus metadata
I20260812 06:13:36.882378 13234 ts_tablet_manager.cc:1918] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:36.882337 11870 catalog_manager.cc:4841] TS eef9430ae97f4fd2b00099aca4e39238 (127.0.176.195:33733): tablet 620bc77da593422fb05e9d3f3324d309 (table test-table [id=baa254c268b343efb5e6fb4a0f4e7351]) successfully deleted
I20260812 06:13:36.882483 13234 log.cc:1196] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/620bc77da593422fb05e9d3f3324d309
I20260812 06:13:36.882731 13234 ts_tablet_manager.cc:1939] T 620bc77da593422fb05e9d3f3324d309 P 5b2e3abf780e4257951f00b670da4be5: Deleting consensus metadata
I20260812 06:13:36.883327 11865 catalog_manager.cc:4841] TS 5b2e3abf780e4257951f00b670da4be5 (127.0.176.194:39591): tablet 620bc77da593422fb05e9d3f3324d309 (table test-table [id=baa254c268b343efb5e6fb4a0f4e7351]) successfully deleted
I20260812 06:13:36.890231 13191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:36.890002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:45165 (local address 127.0.0.1:42044)
0812 06:13:36.890121 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:36.890168 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:45165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 06:13:36.890218 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 12565
W20260812 06:13:36.897310 11870 catalog_manager.cc:4584] TS cf45cb20e47f422f8d238e7d6641cb0a (127.0.176.193:45165): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 620bc77da593422fb05e9d3f3324d309: Network error: Client connection negotiation failed: client connection to 127.0.176.193:45165: connect: Connection refused (error 111)
I20260812 06:13:36.904670 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 12804
I20260812 06:13:36.921240 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 11664
I20260812 06:13:36.941640 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 11989
2026-08-12T06:13:36Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7188 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:13:37 dist-test-slave-gw5c krb5kdc[13240](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:13:37 dist-test-slave-gw5c krb5kdc[13240](info): set up 2 sockets
Aug 12 06:13:37 dist-test-slave-gw5c krb5kdc[13240](info): commencing operation
krb5kdc: starting...
W20260812 06:13:38.264211 707 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:38 dist-test-slave-gw5c krb5kdc[13240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515218, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:38Z Disabled control of system clock
WARNING: no policy specified for oryx/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.254.keytab.
Entry for principal oryx/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.254.keytab.
I20260812 06:13:38.395725 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43055
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.254.keytab
--principal=oryx/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:40697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:43055
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:38.484640 13263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:38.484931 13263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:38.484977 13263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:38.486269 13263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:38.486362 13263 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:13:38.486383 13263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:38.486408 13263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:38.486435 13263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:38.486469 13263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:38.488143 13263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:40697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:43055
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.254.keytab
--principal=oryx/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:38.488488 13263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:38.488756 13263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:38.494218 13276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:38.494266 13274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:38.494274 13263 server_base.cc:1034] running on GCE node
W20260812 06:13:38.494273 13272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:38.494685 13263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:38.495060 13263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:38.496259 13263 hybrid_clock.cc:648] HybridClock initialized: now 1786515218496251 us; error 41 us; skew 500 ppm
Aug 12 06:13:38 dist-test-slave-gw5c krb5kdc[13240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515218, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:38.499054 13263 init.cc:377] Logged in from keytab as oryx/127.0.176.254@KRBTEST.COM (short username oryx)
I20260812 06:13:38.499632 13263 webserver.cc:460] Webserver started at http://127.0.176.254:46199/ using document root <none> and password file <none>
I20260812 06:13:38.499907 13263 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:38.499982 13263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:38.500136 13263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:38.501267 13263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "d0f4d68e18ce40bea214e3b5634e9d51"
format_stamp: "Formatted at 2026-08-12 06:13:38 on dist-test-slave-gw5c"
server_key: "08ee8df73b7ca8df96a4add5d5bd0884"
server_key_iv: "09bab7ea4e7b0beff7677dd70431b101"
server_key_version: "encryptionkey@0"
I20260812 06:13:38.501701 13263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "d0f4d68e18ce40bea214e3b5634e9d51"
format_stamp: "Formatted at 2026-08-12 06:13:38 on dist-test-slave-gw5c"
server_key: "08ee8df73b7ca8df96a4add5d5bd0884"
server_key_iv: "09bab7ea4e7b0beff7677dd70431b101"
server_key_version: "encryptionkey@0"
I20260812 06:13:38.503530 13263 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 06:13:38.504494 13291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:38.504753 13263 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:38.504856 13263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "d0f4d68e18ce40bea214e3b5634e9d51"
format_stamp: "Formatted at 2026-08-12 06:13:38 on dist-test-slave-gw5c"
server_key: "08ee8df73b7ca8df96a4add5d5bd0884"
server_key_iv: "09bab7ea4e7b0beff7677dd70431b101"
server_key_version: "encryptionkey@0"
I20260812 06:13:38.504949 13263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:38.514689 13263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:38.516824 13263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:38.517004 13263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:38.522967 13263 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:43055
I20260812 06:13:38.523061 13395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:43055 every 8 connection(s)
I20260812 06:13:38.523514 13263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:38.524497 13396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:38.526991 13396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51: Bootstrap starting.
I20260812 06:13:38.527745 13396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:38.528050 13396 log.cc:824] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:38.528833 13396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51: No bootstrap required, opened a new log
I20260812 06:13:38.531032 13396 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0f4d68e18ce40bea214e3b5634e9d51" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43055 } }
I20260812 06:13:38.531193 13396 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:38.531216 13396 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0f4d68e18ce40bea214e3b5634e9d51, State: Initialized, Role: FOLLOWER
I20260812 06:13:38.531450 13396 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0f4d68e18ce40bea214e3b5634e9d51" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43055 } }
I20260812 06:13:38.531543 13396 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:38.531587 13396 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:38.531638 13396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:38.532150 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 13263
I20260812 06:13:38.532261 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:38.532495 707 external_mini_cluster.cc:1428] Setting key 22c4a7dd115682f5bc8e87ffff9722ae
I20260812 06:13:38.532481 13396 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0f4d68e18ce40bea214e3b5634e9d51" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43055 } }
I20260812 06:13:38.532589 13396 leader_election.cc:302] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0f4d68e18ce40bea214e3b5634e9d51; no voters:
I20260812 06:13:38.532809 13396 leader_election.cc:288] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:38.532841 13401 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:38.532960 13401 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [term 1 LEADER]: Becoming Leader. State: Replica: d0f4d68e18ce40bea214e3b5634e9d51, State: Running, Role: LEADER
I20260812 06:13:38.533114 13396 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:38.533110 13401 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0f4d68e18ce40bea214e3b5634e9d51" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43055 } }
I20260812 06:13:38.533636 13402 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0f4d68e18ce40bea214e3b5634e9d51. Latest consensus state: current_term: 1 leader_uuid: "d0f4d68e18ce40bea214e3b5634e9d51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0f4d68e18ce40bea214e3b5634e9d51" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43055 } } }
I20260812 06:13:38.533641 13403 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0f4d68e18ce40bea214e3b5634e9d51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0f4d68e18ce40bea214e3b5634e9d51" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43055 } } }
I20260812 06:13:38.533851 13402 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:38.533865 13403 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:38.534199 13423 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:38.535046 13423 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:38.537242 13423 catalog_manager.cc:1347] Generated new cluster ID: 01554d07db9f40388b0b60f34b49e1f5
I20260812 06:13:38.537318 13423 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:13:38 dist-test-slave-gw5c krb5kdc[13240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515218, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
I20260812 06:13:38.545130 13408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:38.533204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40694 (local address 127.0.176.254:43055)
0812 06:13:38.533544 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:38.533554 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:38.533755 (+ 201us) server_negotiation.cc:407] Connection header received
0812 06:13:38.533892 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:38.533899 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:38.533965 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:38.534117 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:38.535135 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.536659 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.537582 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.538015 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.538138 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:38.540710 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:38.540721 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:38.540721 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:38.540737 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:38.543378 (+ 2641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:38.543831 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:38.543835 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:38.543835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:38.543951 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:38.544165 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:38.544166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:38.544166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:38.544461 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:38.544658 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:38.544730 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 06:13:38.544887 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":144,"threads_started":1}
I20260812 06:13:38.570091 13423 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:38.570904 13423 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:38.581347 13423 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51: Generated new TSK 0
I20260812 06:13:38.581617 13423 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab.
Entry for principal oryx/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab.
I20260812 06:13:38.619788 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43055
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab
--principal=oryx/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:40697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:38.716688 13448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:38.716924 13448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:38.716954 13448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:38.718276 13448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:38.718335 13448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:38.718357 13448 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:13:38.718377 13448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:38.720111 13448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:40697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab
--principal=oryx/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.176.254:43055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:38.720407 13448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:38.720794 13448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:38.726390 13459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:38.726394 13457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:38.726547 13448 server_base.cc:1034] running on GCE node
W20260812 06:13:38.726390 13462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:38.726974 13448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:38.727270 13448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:38.728443 13448 hybrid_clock.cc:648] HybridClock initialized: now 1786515218728409 us; error 49 us; skew 500 ppm
Aug 12 06:13:38 dist-test-slave-gw5c krb5kdc[13240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515218, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:38.731290 13448 init.cc:377] Logged in from keytab as oryx/127.0.176.193@KRBTEST.COM (short username oryx)
I20260812 06:13:38.731834 13448 webserver.cc:460] Webserver started at http://127.0.176.193:37787/ using document root <none> and password file <none>
I20260812 06:13:38.732092 13448 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:38.732139 13448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:38.732273 13448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:38.733508 13448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "280c98ce309c4d838d50530d83b263e8"
format_stamp: "Formatted at 2026-08-12 06:13:38 on dist-test-slave-gw5c"
server_key: "f2e03af16df3d52dae7c07b6090d6d75"
server_key_iv: "2e24dd63c1f972c3a6df3e7ad878c1a9"
server_key_version: "encryptionkey@0"
I20260812 06:13:38.733883 13448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "280c98ce309c4d838d50530d83b263e8"
format_stamp: "Formatted at 2026-08-12 06:13:38 on dist-test-slave-gw5c"
server_key: "f2e03af16df3d52dae7c07b6090d6d75"
server_key_iv: "2e24dd63c1f972c3a6df3e7ad878c1a9"
server_key_version: "encryptionkey@0"
I20260812 06:13:38.735370 13448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:13:38.736217 13474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:38.736402 13448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:38.736511 13448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "280c98ce309c4d838d50530d83b263e8"
format_stamp: "Formatted at 2026-08-12 06:13:38 on dist-test-slave-gw5c"
server_key: "f2e03af16df3d52dae7c07b6090d6d75"
server_key_iv: "2e24dd63c1f972c3a6df3e7ad878c1a9"
server_key_version: "encryptionkey@0"
I20260812 06:13:38.736589 13448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:38.753918 13448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:38.756958 13448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:38.757164 13448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:38.757831 13448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:38.757894 13448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:38.757931 13448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:38.757984 13448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:13:38 dist-test-slave-gw5c krb5kdc[13240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515218, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
I20260812 06:13:38.765884 13448 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:43173
I20260812 06:13:38.765971 13683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:43173 every 8 connection(s)
I20260812 06:13:38.766393 13448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:38.767614 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 13448
I20260812 06:13:38.767750 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:38.767994 707 external_mini_cluster.cc:1428] Setting key d8ca10db47d9ff0784562d9c2327475f
I20260812 06:13:38.769383 13408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:38.758337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:37383 (local address 127.0.176.254:43055)
0812 06:13:38.758418 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:38.758420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:38.758629 (+ 209us) server_negotiation.cc:407] Connection header received
0812 06:13:38.759166 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:38.759168 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:38.759186 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:38.759277 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:38.760057 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.760911 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.762090 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.762323 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.762410 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:38.765934 (+ 3524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:38.765936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:38.765937 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:38.765947 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:38.767777 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:38.768250 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:38.768251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:38.768252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:38.768321 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:38.768626 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:38.768626 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:38.768627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:38.768791 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:38.768880 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:38.769151 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 06:13:38.769249 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 06:13:38.769411 13490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:38.758322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43055 (local address 127.0.176.193:37383)
0812 06:13:38.758478 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:38.758522 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:38.759054 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:38.759329 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:38.759333 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:38.759723 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:38.759940 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:38.759945 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.761049 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.761050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:38.761982 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:38.761985 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.762421 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.762422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:38.762554 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:38.763228 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:38.763237 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:38.765789 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:38.767873 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:38.767882 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:38.767884 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:38.768165 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:38.768410 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:38.768411 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:38.768412 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:38.768552 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:38.768878 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:38.768884 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:38.769009 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 06:13:38.769102 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 06:13:38.769244 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":82,"threads_started":1}
I20260812 06:13:38.770954 13684 heartbeater.cc:347] Connected to a master server at 127.0.176.254:43055
I20260812 06:13:38.771047 13684 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:38.771293 13684 heartbeater.cc:511] Master 127.0.176.254:43055 requested a full tablet report, sending...
I20260812 06:13:38.771906 13323 ts_manager.cc:194] Registered new tserver with Master: 280c98ce309c4d838d50530d83b263e8 (127.0.176.193:43173)
I20260812 06:13:38.772847 13323 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:37383
WARNING: no policy specified for oryx/127.0.176.194@KRBTEST.COM; defaulting to no policy
I20260812 06:13:38.779000 13408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:38.772256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:45187 (local address 127.0.176.254:43055)
0812 06:13:38.772298 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:38.772300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:38.772307 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:13:38.772330 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:38.772331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:38.772341 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:38.772406 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:38.772760 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.773468 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.774758 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.774951 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.775015 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:38.776292 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:38.776294 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:38.776294 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:38.776301 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:38.777735 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:38.778202 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:38.778203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:38.778203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:38.778255 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:38.778459 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:38.778459 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:38.778459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:38.778614 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:38.778668 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:38.778845 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 06:13:38.778918 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:13:38.779027 13696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:38.772050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43055 (local address 127.0.176.193:45187)
0812 06:13:38.772217 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:38.772229 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:38.772284 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:38.772412 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:38.772413 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:38.772619 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:38.772675 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:38.772677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.773561 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.773562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:38.774518 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:38.774521 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.775036 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.775038 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:38.775138 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:38.775719 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:38.775725 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:38.776189 (+ 464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:38.777842 (+ 1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:38.777843 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:38.777844 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:38.778113 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:38.778319 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:38.778320 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:38.778320 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:38.778394 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:38.778667 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:38.778668 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:38.778730 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 06:13:38.778812 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 06:13:38.778930 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":105,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab.
Entry for principal oryx/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab.
I20260812 06:13:38.796849 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43055
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab
--principal=oryx/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:40697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:38.884549 13702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:38.884841 13702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:38.884884 13702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:38.886124 13702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:38.886214 13702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:38.886251 13702 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:13:38.886291 13702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:38.888170 13702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:40697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab
--principal=oryx/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.176.254:43055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:38.888506 13702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:38.888782 13702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:38.894197 13717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:38.894197 13720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:38.894310 13702 server_base.cc:1034] running on GCE node
W20260812 06:13:38.894197 13716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:38.894690 13702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:38.895001 13702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:38.896195 13702 hybrid_clock.cc:648] HybridClock initialized: now 1786515218896185 us; error 49 us; skew 500 ppm
Aug 12 06:13:38 dist-test-slave-gw5c krb5kdc[13240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515218, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:38.899175 13702 init.cc:377] Logged in from keytab as oryx/127.0.176.194@KRBTEST.COM (short username oryx)
I20260812 06:13:38.899726 13702 webserver.cc:460] Webserver started at http://127.0.176.194:39895/ using document root <none> and password file <none>
I20260812 06:13:38.899935 13702 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:38.899981 13702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:38.900084 13702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:38.901247 13702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "a023f27f2f02414a8488452cb9827e6b"
format_stamp: "Formatted at 2026-08-12 06:13:38 on dist-test-slave-gw5c"
server_key: "2a6ff0ce2c156b6c2595ff79df2fb52b"
server_key_iv: "cc87c49b382a20366d91f29a411faf72"
server_key_version: "encryptionkey@0"
I20260812 06:13:38.901593 13702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "a023f27f2f02414a8488452cb9827e6b"
format_stamp: "Formatted at 2026-08-12 06:13:38 on dist-test-slave-gw5c"
server_key: "2a6ff0ce2c156b6c2595ff79df2fb52b"
server_key_iv: "cc87c49b382a20366d91f29a411faf72"
server_key_version: "encryptionkey@0"
I20260812 06:13:38.903123 13702 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:13:38.904031 13740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:38.904240 13702 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:13:38.904327 13702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "a023f27f2f02414a8488452cb9827e6b"
format_stamp: "Formatted at 2026-08-12 06:13:38 on dist-test-slave-gw5c"
server_key: "2a6ff0ce2c156b6c2595ff79df2fb52b"
server_key_iv: "cc87c49b382a20366d91f29a411faf72"
server_key_version: "encryptionkey@0"
I20260812 06:13:38.904390 13702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:38.921275 13702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:38.923874 13702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:38.924000 13702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:38.924695 13702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:38.924762 13702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:38.924790 13702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:38.924804 13702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:13:38 dist-test-slave-gw5c krb5kdc[13240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515218, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
I20260812 06:13:38.932899 13702 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:34455
I20260812 06:13:38.933354 13968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:34455 every 8 connection(s)
I20260812 06:13:38.933419 13702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:13:38.936017 13408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:38.925290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:54499 (local address 127.0.176.254:43055)
0812 06:13:38.925386 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:38.925389 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:38.925692 (+ 303us) server_negotiation.cc:407] Connection header received
0812 06:13:38.926524 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:38.926526 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:38.926542 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:38.926658 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:38.927732 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.928248 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.929339 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.929560 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.929652 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:38.932416 (+ 2764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:38.932418 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:38.932418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:38.932429 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:38.934309 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:38.934786 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:38.934788 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:38.934788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:38.934857 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:38.935114 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:38.935115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:38.935115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:38.935250 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:38.935336 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:38.935806 (+ 470us) server_negotiation.cc:299] Negotiation successful
0812 06:13:38.935913 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 06:13:38.936267 13756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:38.925244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43055 (local address 127.0.176.194:54499)
0812 06:13:38.925483 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:38.925537 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:38.926353 (+ 816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:38.926764 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:38.926770 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:38.927238 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:38.927607 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:38.927614 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.928362 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.928363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:38.929229 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:38.929231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.929683 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.929684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:38.929812 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:38.930601 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:38.930611 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:38.932283 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:38.934427 (+ 2144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:38.934434 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:38.934437 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:38.934688 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:38.934922 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:38.934923 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:38.934923 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:38.935036 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:38.935324 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:38.935332 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:38.935527 (+ 195us) client_negotiation.cc:769] Sending connection context
0812 06:13:38.935776 (+ 249us) client_negotiation.cc:240] Negotiation successful
0812 06:13:38.935985 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":126,"threads_started":1}
I20260812 06:13:38.936841 13969 heartbeater.cc:347] Connected to a master server at 127.0.176.254:43055
I20260812 06:13:38.936964 13969 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:38.937160 13969 heartbeater.cc:511] Master 127.0.176.254:43055 requested a full tablet report, sending...
I20260812 06:13:38.937588 13323 ts_manager.cc:194] Registered new tserver with Master: a023f27f2f02414a8488452cb9827e6b (127.0.176.194:34455)
I20260812 06:13:38.938129 13323 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:54499
I20260812 06:13:38.943652 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 13702
I20260812 06:13:38.943802 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:13:38.944078 707 external_mini_cluster.cc:1428] Setting key 0045dae4063f41460fbfd553f5059f01
I20260812 06:13:38.944878 13408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:38.938091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:33541 (local address 127.0.176.254:43055)
0812 06:13:38.938139 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:38.938141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:38.938299 (+ 158us) server_negotiation.cc:407] Connection header received
0812 06:13:38.938366 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:38.938368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:38.938379 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:38.938444 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:38.938858 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.939371 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.940380 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.940745 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.940823 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:38.941839 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:38.941841 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:38.941841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:38.941847 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:38.943348 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:38.943936 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:38.943937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:38.943937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:38.943996 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:38.944243 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:38.944244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:38.944244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:38.944414 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:38.944502 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:38.944683 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 06:13:38.944776 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:13:38.944906 13980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:38.938021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43055 (local address 127.0.176.194:33541)
0812 06:13:38.938217 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:38.938241 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:38.938314 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:38.938447 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:38.938447 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:38.938698 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:38.938772 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:38.938774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.939567 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.939568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:38.940275 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:38.940278 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:38.940850 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:38.940851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:38.940919 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:38.941398 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:38.941402 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:38.941749 (+ 347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:38.943565 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:38.943567 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:38.943567 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:38.943850 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:38.944065 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:38.944066 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:38.944066 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:38.944143 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:38.944495 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:38.944496 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:38.944552 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 06:13:38.944657 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 06:13:38.944778 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":75,"threads_started":1}
WARNING: no policy specified for oryx/127.0.176.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab.
Entry for principal oryx/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab.
I20260812 06:13:38.973943 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43055
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab
--principal=oryx/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:40697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:39.065696 13983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:39.065928 13983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:39.065955 13983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:39.067090 13983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:39.067127 13983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:39.067147 13983 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:13:39.067165 13983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:39.068652 13983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:40697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab
--principal=oryx/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.0.176.254:43055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:39.068853 13983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:39.069042 13983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:39.074259 13995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:39.074450 13983 server_base.cc:1034] running on GCE node
W20260812 06:13:39.074323 13994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:39.074265 14003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:39.074769 13983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:39.075038 13983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:39.076180 13983 hybrid_clock.cc:648] HybridClock initialized: now 1786515219076169 us; error 30 us; skew 500 ppm
Aug 12 06:13:39 dist-test-slave-gw5c krb5kdc[13240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515219, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:39.078719 13983 init.cc:377] Logged in from keytab as oryx/127.0.176.195@KRBTEST.COM (short username oryx)
I20260812 06:13:39.079206 13983 webserver.cc:460] Webserver started at http://127.0.176.195:36209/ using document root <none> and password file <none>
I20260812 06:13:39.079469 13983 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:39.079519 13983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:39.079613 13983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:39.080649 13983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "7ab47cff7d2f4973818072e18bf48945"
format_stamp: "Formatted at 2026-08-12 06:13:39 on dist-test-slave-gw5c"
server_key: "d784b454e82281e063a11c22173c6d71"
server_key_iv: "ca165109fd085cb7655d99fdfb810d1d"
server_key_version: "encryptionkey@0"
I20260812 06:13:39.080962 13983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "7ab47cff7d2f4973818072e18bf48945"
format_stamp: "Formatted at 2026-08-12 06:13:39 on dist-test-slave-gw5c"
server_key: "d784b454e82281e063a11c22173c6d71"
server_key_iv: "ca165109fd085cb7655d99fdfb810d1d"
server_key_version: "encryptionkey@0"
I20260812 06:13:39.082341 13983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:13:39.083062 14012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:39.083246 13983 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:13:39.083336 13983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "7ab47cff7d2f4973818072e18bf48945"
format_stamp: "Formatted at 2026-08-12 06:13:39 on dist-test-slave-gw5c"
server_key: "d784b454e82281e063a11c22173c6d71"
server_key_iv: "ca165109fd085cb7655d99fdfb810d1d"
server_key_version: "encryptionkey@0"
I20260812 06:13:39.083443 13983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:39.091789 13983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:39.094358 13983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:39.094491 13983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:39.095034 13983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:39.095075 13983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:39.095098 13983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:39.095115 13983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:39.103048 13983 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:45883
I20260812 06:13:39.103117 14205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:45883 every 8 connection(s)
Aug 12 06:13:39 dist-test-slave-gw5c krb5kdc[13240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515219, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
I20260812 06:13:39.103672 13983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:13:39.107429 13408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.095829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:50619 (local address 127.0.176.254:43055)
0812 06:13:39.095902 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.095904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.096163 (+ 259us) server_negotiation.cc:407] Connection header received
0812 06:13:39.096919 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.096921 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.096934 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.097026 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:39.098211 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.099080 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.100847 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.101090 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.101151 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.104221 (+ 3070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:39.104223 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:39.104223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:39.104232 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:39.105808 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:39.106303 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:39.106304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:39.106304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:39.106375 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:39.106662 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:39.106663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:39.106663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:39.106798 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:39.106884 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.107188 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.107293 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:13:39.107669 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.095839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43055 (local address 127.0.176.195:50619)
0812 06:13:39.096036 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.096074 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.096801 (+ 727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.097169 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.097175 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.097740 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:39.098081 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.098088 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.099195 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.099196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.100744 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.100747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.101193 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.101195 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.101363 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.102075 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:39.102087 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:39.104098 (+ 2011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:39.105938 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:39.105948 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:39.105951 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:39.106213 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:39.106452 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:39.106453 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:39.106453 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:39.106589 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:39.106868 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:39.106875 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:39.107036 (+ 161us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.107149 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.107334 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":103,"threads_started":1}
I20260812 06:13:39.108300 14206 heartbeater.cc:347] Connected to a master server at 127.0.176.254:43055
I20260812 06:13:39.108419 14206 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:39.108641 14206 heartbeater.cc:511] Master 127.0.176.254:43055 requested a full tablet report, sending...
I20260812 06:13:39.109069 13319 ts_manager.cc:194] Registered new tserver with Master: 7ab47cff7d2f4973818072e18bf48945 (127.0.176.195:45883)
I20260812 06:13:39.109638 13319 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:50619
I20260812 06:13:39.110975 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 13983
I20260812 06:13:39.111088 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:13:39.111294 707 external_mini_cluster.cc:1428] Setting key fdae9e7ec208abca498b36083d16475b
I20260812 06:13:39.112300 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:13:39.115801 14214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.109432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43055 (local address 127.0.176.195:35187)
0812 06:13:39.109575 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.109587 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.109671 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.109821 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.109822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.110058 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:39.110121 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.110123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.110885 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.110886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.111742 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.111745 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.112213 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.112214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.112286 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.112804 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:39.112809 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:39.113118 (+ 309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:39.114634 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:39.114635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:39.114636 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:39.114817 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:39.115038 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:39.115039 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:39.115039 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:39.115101 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:39.115372 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:39.115373 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:39.115483 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.115571 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.115691 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":88,"threads_started":1}
I20260812 06:13:39.115787 13408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.109474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:35187 (local address 127.0.176.254:43055)
0812 06:13:39.109516 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.109518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.109655 (+ 137us) server_negotiation.cc:407] Connection header received
0812 06:13:39.109730 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.109731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.109741 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.109791 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:39.110199 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.110790 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.111879 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.112147 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.112214 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.113213 (+ 999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:39.113214 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:39.113214 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:39.113222 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:39.114532 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:39.114893 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:39.114894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:39.114895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:39.114962 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:39.115176 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:39.115177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:39.115177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:39.115301 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:39.115381 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.115599 (+ 218us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.115688 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
Aug 12 06:13:39 dist-test-slave-gw5c krb5kdc[13240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515219, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:13:39 dist-test-slave-gw5c krb5kdc[13240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:39 dist-test-slave-gw5c krb5kdc[13240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:13:39.139582 13408 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:39.132764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40702 (local address 127.0.176.254:43055)
0812 06:13:39.132870 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.132872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.132907 (+ 35us) server_negotiation.cc:407] Connection header received
0812 06:13:39.132973 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.132975 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.132985 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.133042 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:39.134006 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.134614 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.135456 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.135666 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.135733 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.139449 (+ 3716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40702: BlockingRecv error: recv got EOF from 127.0.0.1:40702 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 12 06:13:39 dist-test-slave-gw5c krb5kdc[13240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515219, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
I20260812 06:13:39.147704 13408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.140461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40710 (local address 127.0.176.254:43055)
0812 06:13:39.140510 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.140512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.140571 (+ 59us) server_negotiation.cc:407] Connection header received
0812 06:13:39.140622 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.140622 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.140631 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.140680 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:39.141159 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.141642 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.142312 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.142506 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.142561 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.144868 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:39.144870 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:39.144870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:39.144882 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:39.146370 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:39.146746 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:39.146747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:39.146748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:39.146810 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:39.147024 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:39.147025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:39.147026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:39.147154 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:39.147241 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.147344 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.147576 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:13:39.149504 13319 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40710:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:13:39.151208 13319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:39.158721 14240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.154297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49304 (local address 127.0.176.195:45883)
0812 06:13:39.154494 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.154498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.154726 (+ 228us) server_negotiation.cc:407] Connection header received
0812 06:13:39.154777 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.154779 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.154796 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.154880 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:39.155836 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.156815 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.157736 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.158277 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.158373 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.158458 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.158570 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.158612 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":90,"threads_started":1}
I20260812 06:13:39.158711 14238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.154164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:45883 (local address 127.0.0.1:49304)
0812 06:13:39.154550 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.154560 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.154618 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.155479 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.155480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.155483 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:39.155532 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.155533 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.156897 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.156899 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.157636 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.157638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.158372 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.158373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.158458 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.158476 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.158554 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.158616 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":78,"threads_started":1}
I20260812 06:13:39.159075 14234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.153954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:43173 (local address 127.0.0.1:52516)
0812 06:13:39.154324 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.154366 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.154445 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.154771 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.154774 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.154776 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:39.154884 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.154886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.156559 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.156560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.157708 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.157711 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.158788 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.158788 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.158857 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.158864 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.158918 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.158982 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":30,"thread_start_us":59,"threads_started":1}
I20260812 06:13:39.159250 14237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.154109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47532 (local address 127.0.176.194:34455)
0812 06:13:39.154417 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.154421 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.154448 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:13:39.154588 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.154591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.154608 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.154681 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:39.154968 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.156004 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.157824 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.158592 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.158667 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.158739 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.159096 (+ 357us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.159141 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":100,"threads_started":1}
I20260812 06:13:39.159350 14236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.154124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52516 (local address 127.0.176.193:43173)
0812 06:13:39.154336 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.154341 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.154488 (+ 147us) server_negotiation.cc:407] Connection header received
0812 06:13:39.154533 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.154535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.154551 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.154633 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:39.155190 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.156456 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.157835 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.158592 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.158667 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.158740 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.159186 (+ 446us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.159238 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":90,"threads_started":1}
I20260812 06:13:39.159499 14235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.153954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:34455 (local address 127.0.0.1:47532)
0812 06:13:39.154316 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.154366 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.154440 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.154770 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.154773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.154775 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:39.154879 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.154882 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.156103 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.156104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.157728 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.157730 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.158781 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.158782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.158857 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.158866 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.158918 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.159420 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":29,"thread_start_us":101,"threads_started":1}
I20260812 06:13:39.159716 14095 tablet_service.cc:1467] Processing CreateTablet for tablet 77328afc93c24a288fdae4bbbd673d99 (DEFAULT_TABLE table=test-table [id=8d54b6f9acd449839df3855b67b749f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:39.159967 13571 tablet_service.cc:1467] Processing CreateTablet for tablet 77328afc93c24a288fdae4bbbd673d99 (DEFAULT_TABLE table=test-table [id=8d54b6f9acd449839df3855b67b749f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:39.160154 14095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77328afc93c24a288fdae4bbbd673d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.160346 13571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77328afc93c24a288fdae4bbbd673d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.160455 13837 tablet_service.cc:1467] Processing CreateTablet for tablet 77328afc93c24a288fdae4bbbd673d99 (DEFAULT_TABLE table=test-table [id=8d54b6f9acd449839df3855b67b749f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:39.160796 13837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77328afc93c24a288fdae4bbbd673d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.164134 14243 tablet_bootstrap.cc:492] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8: Bootstrap starting.
I20260812 06:13:39.164845 14245 tablet_bootstrap.cc:492] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945: Bootstrap starting.
I20260812 06:13:39.164950 14243 tablet_bootstrap.cc:654] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.165392 14243 log.cc:824] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:39.165410 14246 tablet_bootstrap.cc:492] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b: Bootstrap starting.
I20260812 06:13:39.165604 14245 tablet_bootstrap.cc:654] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.165975 14245 log.cc:824] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:39.166210 14246 tablet_bootstrap.cc:654] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.166344 14243 tablet_bootstrap.cc:492] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8: No bootstrap required, opened a new log
I20260812 06:13:39.166446 14243 ts_tablet_manager.cc:1397] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:13:39.166589 14246 log.cc:824] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:39.167529 14245 tablet_bootstrap.cc:492] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945: No bootstrap required, opened a new log
I20260812 06:13:39.167625 14245 ts_tablet_manager.cc:1397] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:13:39.168205 14246 tablet_bootstrap.cc:492] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b: No bootstrap required, opened a new log
I20260812 06:13:39.168277 14246 ts_tablet_manager.cc:1397] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:13:39.168871 14243 raft_consensus.cc:348] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.169051 14243 raft_consensus.cc:374] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.169085 14243 raft_consensus.cc:729] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 280c98ce309c4d838d50530d83b263e8, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.169242 14243 consensus_queue.cc:260] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.169564 14243 ts_tablet_manager.cc:1428] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:13:39.169694 13684 heartbeater.cc:503] Master 127.0.176.254:43055 was elected leader, sending a full tablet report...
I20260812 06:13:39.169633 14245 raft_consensus.cc:348] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.169781 14245 raft_consensus.cc:374] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.169812 14245 raft_consensus.cc:729] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab47cff7d2f4973818072e18bf48945, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.169914 14245 consensus_queue.cc:260] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.170337 14245 ts_tablet_manager.cc:1428] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:13:39.170416 14246 raft_consensus.cc:348] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.170570 14206 heartbeater.cc:503] Master 127.0.176.254:43055 was elected leader, sending a full tablet report...
I20260812 06:13:39.170594 14246 raft_consensus.cc:374] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.170636 14246 raft_consensus.cc:729] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a023f27f2f02414a8488452cb9827e6b, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.171106 14246 consensus_queue.cc:260] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.171528 14246 ts_tablet_manager.cc:1428] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:13:39.171689 13969 heartbeater.cc:503] Master 127.0.176.254:43055 was elected leader, sending a full tablet report...
W20260812 06:13:39.184226 13971 tablet.cc:2369] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:13:39.267547 13685 tablet.cc:2369] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:13:39.293395 14257 raft_consensus.cc:482] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:39.293540 14257 raft_consensus.cc:504] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.293991 14257 leader_election.cc:288] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 280c98ce309c4d838d50530d83b263e8 (127.0.176.193:43173), 7ab47cff7d2f4973818072e18bf48945 (127.0.176.195:45883)
I20260812 06:13:39.297029 14236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.294378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:58493 (local address 127.0.176.193:43173)
0812 06:13:39.294436 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.294439 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.294452 (+ 13us) server_negotiation.cc:407] Connection header received
0812 06:13:39.294493 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.294494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.294504 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.294566 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:39.294767 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.295255 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.296262 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.296631 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.296732 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.296743 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.296915 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.296956 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:13:39.297029 13756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.294258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:43173 (local address 127.0.176.194:58493)
0812 06:13:39.294329 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.294343 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.294435 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.294619 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.294620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.294622 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:39.294689 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.294691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.295356 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.295357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.296163 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.296165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.296731 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.296732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.296833 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.296836 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.296910 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.296952 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 06:13:39.297204 14240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.294523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:39335 (local address 127.0.176.195:45883)
0812 06:13:39.294589 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.294591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.294709 (+ 118us) server_negotiation.cc:407] Connection header received
0812 06:13:39.294779 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.294780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.294789 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.294866 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:39.295026 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.295558 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.296473 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.296845 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.296932 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.296941 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.297100 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.297137 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 06:13:39.297216 14262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.294394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:45883 (local address 127.0.176.194:39335)
0812 06:13:39.294638 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.294651 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.294721 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.294869 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.294870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.294871 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:39.294948 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.294955 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.295640 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.295641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.296376 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.296378 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.296932 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.296933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.297008 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.297016 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.297092 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.297128 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":150,"threads_started":1}
I20260812 06:13:39.297418 13604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77328afc93c24a288fdae4bbbd673d99" candidate_uuid: "a023f27f2f02414a8488452cb9827e6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "280c98ce309c4d838d50530d83b263e8" is_pre_election: true
I20260812 06:13:39.297607 13604 raft_consensus.cc:2454] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a023f27f2f02414a8488452cb9827e6b in term 0.
I20260812 06:13:39.297966 13745 leader_election.cc:302] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 280c98ce309c4d838d50530d83b263e8, a023f27f2f02414a8488452cb9827e6b; no voters:
I20260812 06:13:39.298022 14126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77328afc93c24a288fdae4bbbd673d99" candidate_uuid: "a023f27f2f02414a8488452cb9827e6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab47cff7d2f4973818072e18bf48945" is_pre_election: true
I20260812 06:13:39.298166 14126 raft_consensus.cc:2454] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a023f27f2f02414a8488452cb9827e6b in term 0.
I20260812 06:13:39.298142 14257 raft_consensus.cc:2781] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:39.298231 14257 raft_consensus.cc:482] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:39.298264 14257 raft_consensus.cc:3037] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:39.299314 14257 raft_consensus.cc:504] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.299500 14257 leader_election.cc:288] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [CANDIDATE]: Term 1 election: Requested vote from peers 280c98ce309c4d838d50530d83b263e8 (127.0.176.193:43173), 7ab47cff7d2f4973818072e18bf48945 (127.0.176.195:45883)
I20260812 06:13:39.299672 13604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77328afc93c24a288fdae4bbbd673d99" candidate_uuid: "a023f27f2f02414a8488452cb9827e6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "280c98ce309c4d838d50530d83b263e8"
I20260812 06:13:39.299714 14126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77328afc93c24a288fdae4bbbd673d99" candidate_uuid: "a023f27f2f02414a8488452cb9827e6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab47cff7d2f4973818072e18bf48945"
I20260812 06:13:39.299805 14126 raft_consensus.cc:3037] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:39.299772 13604 raft_consensus.cc:3037] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:39.300518 13604 raft_consensus.cc:2454] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a023f27f2f02414a8488452cb9827e6b in term 1.
I20260812 06:13:39.300661 14126 raft_consensus.cc:2454] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a023f27f2f02414a8488452cb9827e6b in term 1.
I20260812 06:13:39.300730 13745 leader_election.cc:302] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 280c98ce309c4d838d50530d83b263e8, a023f27f2f02414a8488452cb9827e6b; no voters:
I20260812 06:13:39.300866 14257 raft_consensus.cc:2781] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:39.301043 14257 raft_consensus.cc:686] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [term 1 LEADER]: Becoming Leader. State: Replica: a023f27f2f02414a8488452cb9827e6b, State: Running, Role: LEADER
I20260812 06:13:39.301151 14257 consensus_queue.cc:237] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.302039 13319 catalog_manager.cc:5495] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b reported cstate change: term changed from 0 to 1, leader changed from <none> to a023f27f2f02414a8488452cb9827e6b (127.0.176.194). New cstate: current_term: 1 leader_uuid: "a023f27f2f02414a8488452cb9827e6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } health_report { overall_health: UNKNOWN } } }
I20260812 06:13:39.310307 14237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.307681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47548 (local address 127.0.176.194:34455)
0812 06:13:39.307731 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.307733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.307742 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:39.307856 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.307857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.307876 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.307956 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:39.308130 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.308669 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.309494 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.309691 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.309770 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.309968 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:39.310074 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:39.310169 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.310194 (+ 25us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.310216 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:13:39.312570 13604 raft_consensus.cc:1261] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Refusing update from remote peer a023f27f2f02414a8488452cb9827e6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:39.312628 14126 raft_consensus.cc:1261] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Refusing update from remote peer a023f27f2f02414a8488452cb9827e6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:39.313025 14257 consensus_queue.cc:1035] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:39.313218 14264 consensus_queue.cc:1035] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:39.316337 14268 mvcc.cc:205] Tried to move back new op lower bound from 7317566338301095936 to 7317566338258178048. Current Snapshot: MvccSnapshot[applied={T|T < 7317566338301095936}]
I20260812 06:13:39.319144 13318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:39.319284 13318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:39.320259 13318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51: Sending DeleteTablet for 3 replicas of tablet 77328afc93c24a288fdae4bbbd673d99
I20260812 06:13:39.320636 13837 tablet_service.cc:1514] Processing DeleteTablet for tablet 77328afc93c24a288fdae4bbbd673d99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:39 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:47532
I20260812 06:13:39.320662 13571 tablet_service.cc:1514] Processing DeleteTablet for tablet 77328afc93c24a288fdae4bbbd673d99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:39 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:52516
I20260812 06:13:39.320919 14095 tablet_service.cc:1514] Processing DeleteTablet for tablet 77328afc93c24a288fdae4bbbd673d99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:39 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:49304
I20260812 06:13:39.321023 13318 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40710:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:13:39.321190 13318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:39.321189 14292 tablet_replica.cc:330] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945: stopping tablet replica
I20260812 06:13:39.321331 14292 raft_consensus.cc:2229] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:39.321328 14290 tablet_replica.cc:330] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b: stopping tablet replica
I20260812 06:13:39.321429 14290 raft_consensus.cc:2229] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:13:39.321460 14292 raft_consensus.cc:2258] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:39.321565 14290 raft_consensus.cc:2258] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:39.322053 14292 ts_tablet_manager.cc:1905] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:39.322149 14290 ts_tablet_manager.cc:1905] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:39.323109 13837 tablet_service.cc:1467] Processing CreateTablet for tablet 8b58cd4d85444d3b80f82437dab269df (DEFAULT_TABLE table=test-table [id=17b53ea1ab8b4f8093ba7499447eeb45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:39.323240 13837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b58cd4d85444d3b80f82437dab269df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.323542 14291 tablet_replica.cc:330] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8: stopping tablet replica
I20260812 06:13:39.323756 13571 tablet_service.cc:1467] Processing CreateTablet for tablet 8b58cd4d85444d3b80f82437dab269df (DEFAULT_TABLE table=test-table [id=17b53ea1ab8b4f8093ba7499447eeb45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:39.323887 13571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b58cd4d85444d3b80f82437dab269df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.323918 14095 tablet_service.cc:1467] Processing CreateTablet for tablet 8b58cd4d85444d3b80f82437dab269df (DEFAULT_TABLE table=test-table [id=17b53ea1ab8b4f8093ba7499447eeb45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:39.324013 14095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b58cd4d85444d3b80f82437dab269df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.324576 14292 ts_tablet_manager.cc:1918] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:39.324645 14292 log.cc:1196] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/77328afc93c24a288fdae4bbbd673d99
I20260812 06:13:39.324926 14292 ts_tablet_manager.cc:1939] T 77328afc93c24a288fdae4bbbd673d99 P 7ab47cff7d2f4973818072e18bf48945: Deleting consensus metadata
I20260812 06:13:39.325322 14243 tablet_bootstrap.cc:492] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8: Bootstrap starting.
I20260812 06:13:39.325304 14245 tablet_bootstrap.cc:492] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945: Bootstrap starting.
I20260812 06:13:39.323743 14291 raft_consensus.cc:2229] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:39.325769 14245 tablet_bootstrap.cc:654] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.325753 14243 tablet_bootstrap.cc:654] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.326267 13297 catalog_manager.cc:4841] TS 7ab47cff7d2f4973818072e18bf48945 (127.0.176.195:45883): tablet 77328afc93c24a288fdae4bbbd673d99 (table test-table [id=8d54b6f9acd449839df3855b67b749f8]) successfully deleted
I20260812 06:13:39.326529 14245 tablet_bootstrap.cc:492] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945: No bootstrap required, opened a new log
I20260812 06:13:39.326586 14245 ts_tablet_manager.cc:1397] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:39.326742 14245 raft_consensus.cc:348] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.326809 14245 raft_consensus.cc:374] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.326831 14245 raft_consensus.cc:729] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab47cff7d2f4973818072e18bf48945, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.326874 14245 consensus_queue.cc:260] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.326961 14245 ts_tablet_manager.cc:1428] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:39.327327 14246 tablet_bootstrap.cc:492] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b: Bootstrap starting.
I20260812 06:13:39.327845 14246 tablet_bootstrap.cc:654] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.328202 14290 ts_tablet_manager.cc:1918] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:39.328310 14290 log.cc:1196] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/77328afc93c24a288fdae4bbbd673d99
I20260812 06:13:39.328485 14246 tablet_bootstrap.cc:492] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b: No bootstrap required, opened a new log
I20260812 06:13:39.328547 14246 ts_tablet_manager.cc:1397] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:39.328621 14290 ts_tablet_manager.cc:1939] T 77328afc93c24a288fdae4bbbd673d99 P a023f27f2f02414a8488452cb9827e6b: Deleting consensus metadata
I20260812 06:13:39.328684 14246 raft_consensus.cc:348] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.328761 14246 raft_consensus.cc:374] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.328784 14246 raft_consensus.cc:729] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a023f27f2f02414a8488452cb9827e6b, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.328836 14246 consensus_queue.cc:260] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.328923 14246 ts_tablet_manager.cc:1428] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 06:13:39.329161 13296 catalog_manager.cc:4841] TS a023f27f2f02414a8488452cb9827e6b (127.0.176.194:34455): tablet 77328afc93c24a288fdae4bbbd673d99 (table test-table [id=8d54b6f9acd449839df3855b67b749f8]) successfully deleted
I20260812 06:13:39.325740 14291 raft_consensus.cc:2258] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:39.329850 14243 tablet_bootstrap.cc:492] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8: No bootstrap required, opened a new log
I20260812 06:13:39.329905 14243 ts_tablet_manager.cc:1397] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260812 06:13:39.330071 14243 raft_consensus.cc:348] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.330123 14243 raft_consensus.cc:374] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.330137 14243 raft_consensus.cc:729] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 280c98ce309c4d838d50530d83b263e8, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.330204 14243 consensus_queue.cc:260] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.330312 14243 ts_tablet_manager.cc:1428] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:39.330776 14291 ts_tablet_manager.cc:1905] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:39.332450 14291 ts_tablet_manager.cc:1918] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:39.332598 14291 log.cc:1196] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/wal/wals/77328afc93c24a288fdae4bbbd673d99
I20260812 06:13:39.333189 14291 ts_tablet_manager.cc:1939] T 77328afc93c24a288fdae4bbbd673d99 P 280c98ce309c4d838d50530d83b263e8: Deleting consensus metadata
I20260812 06:13:39.333714 13297 catalog_manager.cc:4841] TS 280c98ce309c4d838d50530d83b263e8 (127.0.176.193:43173): tablet 77328afc93c24a288fdae4bbbd673d99 (table test-table [id=8d54b6f9acd449839df3855b67b749f8]) successfully deleted
W20260812 06:13:39.354385 14207 tablet.cc:2369] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:13:39.421388 14255 raft_consensus.cc:482] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:39.421545 14255 raft_consensus.cc:504] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.421991 14255 leader_election.cc:288] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 280c98ce309c4d838d50530d83b263e8 (127.0.176.193:43173), a023f27f2f02414a8488452cb9827e6b (127.0.176.194:34455)
I20260812 06:13:39.426553 14237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.422390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:43161 (local address 127.0.176.194:34455)
0812 06:13:39.422439 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.422441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.422463 (+ 22us) server_negotiation.cc:407] Connection header received
0812 06:13:39.422631 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.422632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.422647 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.422856 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:39.422900 (+ 44us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.423831 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.425649 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.426051 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.426157 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.426169 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.426419 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.426472 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:13:39.426582 14296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.422252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:34455 (local address 127.0.176.195:43161)
0812 06:13:39.422398 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.422409 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.422459 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.422726 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.422727 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.422729 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:39.422808 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.422811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.423978 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.423979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.425461 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.425468 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.426181 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.426183 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.426271 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.426274 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.426397 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.426457 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":74,"thread_start_us":69,"threads_started":1}
I20260812 06:13:39.426743 14236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.422285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:53953 (local address 127.0.176.193:43173)
0812 06:13:39.422337 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.422339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.422349 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:39.422472 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.422473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.422485 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.422536 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:39.422915 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.423739 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.425646 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.426219 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.426325 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.426335 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.426621 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.426673 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:13:39.426584 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.422224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:43173 (local address 127.0.176.195:53953)
0812 06:13:39.422282 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.422295 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.422343 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.422726 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.422727 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.422730 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:39.422808 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.422811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.423905 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.423908 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.425460 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.425468 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.426335 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.426336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.426422 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.426425 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.426473 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.426524 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":5}
I20260812 06:13:39.427110 13604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b58cd4d85444d3b80f82437dab269df" candidate_uuid: "7ab47cff7d2f4973818072e18bf48945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "280c98ce309c4d838d50530d83b263e8" is_pre_election: true
I20260812 06:13:39.427224 13604 raft_consensus.cc:2454] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab47cff7d2f4973818072e18bf48945 in term 0.
I20260812 06:13:39.427459 14018 leader_election.cc:302] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 280c98ce309c4d838d50530d83b263e8, 7ab47cff7d2f4973818072e18bf48945; no voters:
I20260812 06:13:39.427661 14255 raft_consensus.cc:2781] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:39.427726 14255 raft_consensus.cc:482] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:39.427757 14255 raft_consensus.cc:3037] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:39.427152 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b58cd4d85444d3b80f82437dab269df" candidate_uuid: "7ab47cff7d2f4973818072e18bf48945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a023f27f2f02414a8488452cb9827e6b" is_pre_election: true
I20260812 06:13:39.427896 13880 raft_consensus.cc:2454] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab47cff7d2f4973818072e18bf48945 in term 0.
I20260812 06:13:39.428624 14255 raft_consensus.cc:504] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.428781 14255 leader_election.cc:288] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [CANDIDATE]: Term 1 election: Requested vote from peers 280c98ce309c4d838d50530d83b263e8 (127.0.176.193:43173), a023f27f2f02414a8488452cb9827e6b (127.0.176.194:34455)
I20260812 06:13:39.428944 13604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b58cd4d85444d3b80f82437dab269df" candidate_uuid: "7ab47cff7d2f4973818072e18bf48945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "280c98ce309c4d838d50530d83b263e8"
I20260812 06:13:39.429003 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b58cd4d85444d3b80f82437dab269df" candidate_uuid: "7ab47cff7d2f4973818072e18bf48945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a023f27f2f02414a8488452cb9827e6b"
I20260812 06:13:39.429050 13604 raft_consensus.cc:3037] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:39.429072 13880 raft_consensus.cc:3037] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:39.429718 13604 raft_consensus.cc:2454] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab47cff7d2f4973818072e18bf48945 in term 1.
I20260812 06:13:39.429909 14018 leader_election.cc:302] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 280c98ce309c4d838d50530d83b263e8, 7ab47cff7d2f4973818072e18bf48945; no voters:
I20260812 06:13:39.429976 13880 raft_consensus.cc:2454] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab47cff7d2f4973818072e18bf48945 in term 1.
I20260812 06:13:39.430022 14255 raft_consensus.cc:2781] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:39.430202 14255 raft_consensus.cc:686] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [term 1 LEADER]: Becoming Leader. State: Replica: 7ab47cff7d2f4973818072e18bf48945, State: Running, Role: LEADER
I20260812 06:13:39.430286 14255 consensus_queue.cc:237] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.431088 13319 catalog_manager.cc:5495] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ab47cff7d2f4973818072e18bf48945 (127.0.176.195). New cstate: current_term: 1 leader_uuid: "7ab47cff7d2f4973818072e18bf48945" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } health_report { overall_health: HEALTHY } } }
Aug 12 06:13:39 dist-test-slave-gw5c krb5kdc[13240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515218, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.254@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
I20260812 06:13:39.489104 14306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.480613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43055 (local address 127.0.0.1:40726)
0812 06:13:39.480932 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.480945 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.481051 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.481261 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.481262 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.481860 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:39.481923 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.481927 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.482798 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.482800 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.483378 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.483380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.483816 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.483817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.483875 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.484525 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:39.484530 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:39.486107 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:39.487968 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:39.487979 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:39.487982 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:39.488209 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:39.488455 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:39.488456 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:39.488456 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:39.488526 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:39.488781 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:39.488791 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:39.488840 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.488897 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.489012 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":180,"threads_started":1}
I20260812 06:13:39.489213 13408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.480659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40726 (local address 127.0.176.254:43055)
0812 06:13:39.480779 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.480782 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.481027 (+ 245us) server_negotiation.cc:407] Connection header received
0812 06:13:39.481138 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.481139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.481157 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.481238 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:39.482049 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.482561 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.483523 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.483718 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.483814 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.486217 (+ 2403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:39.486219 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:39.486219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:39.486227 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:39.487824 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:39.488297 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:39.488298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:39.488298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:39.488358 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:39.488599 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:39.488600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:39.488600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:39.488720 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:39.488784 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.488931 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.489078 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":72,"server-negotiator.queue_time_us":81}
I20260812 06:13:39.491670 13319 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:40726:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 06:13:39.491945 13319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:39.493696 13837 tablet_service.cc:1467] Processing CreateTablet for tablet 3930df5f7dd04d4d94ba7c0cce7b161b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4bcb1fcc62ef46e8b4907681b6188f68]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:13:39.493692 14095 tablet_service.cc:1467] Processing CreateTablet for tablet 3930df5f7dd04d4d94ba7c0cce7b161b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4bcb1fcc62ef46e8b4907681b6188f68]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:13:39.493897 13837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3930df5f7dd04d4d94ba7c0cce7b161b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.493896 14095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3930df5f7dd04d4d94ba7c0cce7b161b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.495201 14245 tablet_bootstrap.cc:492] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945: Bootstrap starting.
I20260812 06:13:39.495337 13571 tablet_service.cc:1467] Processing CreateTablet for tablet 3930df5f7dd04d4d94ba7c0cce7b161b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4bcb1fcc62ef46e8b4907681b6188f68]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:13:39.495548 13571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3930df5f7dd04d4d94ba7c0cce7b161b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.495721 14245 tablet_bootstrap.cc:654] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.496502 14245 tablet_bootstrap.cc:492] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945: No bootstrap required, opened a new log
I20260812 06:13:39.496562 14245 ts_tablet_manager.cc:1397] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:39.496722 14245 raft_consensus.cc:348] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.496809 14245 raft_consensus.cc:374] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.496831 14245 raft_consensus.cc:729] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab47cff7d2f4973818072e18bf48945, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.496889 14245 consensus_queue.cc:260] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.497011 14245 ts_tablet_manager.cc:1428] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 06:13:39.497074 14255 tablet_replica.cc:439] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } } }
I20260812 06:13:39.497184 14255 tablet_replica.cc:442] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:39.497228 14243 tablet_bootstrap.cc:492] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8: Bootstrap starting.
I20260812 06:13:39.497375 14246 tablet_bootstrap.cc:492] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b: Bootstrap starting.
I20260812 06:13:39.497741 14243 tablet_bootstrap.cc:654] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.497795 14246 tablet_bootstrap.cc:654] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.498523 14246 tablet_bootstrap.cc:492] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b: No bootstrap required, opened a new log
I20260812 06:13:39.498571 14246 ts_tablet_manager.cc:1397] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:39.498660 14246 raft_consensus.cc:348] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.498768 14246 raft_consensus.cc:374] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.498803 14246 raft_consensus.cc:729] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a023f27f2f02414a8488452cb9827e6b, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.498857 14246 consensus_queue.cc:260] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.498986 14246 ts_tablet_manager.cc:1428] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:39.499022 14283 tablet_replica.cc:439] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } } }
I20260812 06:13:39.499127 14283 tablet_replica.cc:442] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:39.499531 14243 tablet_bootstrap.cc:492] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8: No bootstrap required, opened a new log
I20260812 06:13:39.499611 14243 ts_tablet_manager.cc:1397] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:13:39.499800 14243 raft_consensus.cc:348] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.499879 14243 raft_consensus.cc:374] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.499894 14243 raft_consensus.cc:729] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 280c98ce309c4d838d50530d83b263e8, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.499972 14243 consensus_queue.cc:260] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.500061 14243 ts_tablet_manager.cc:1428] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 06:13:39.500272 14254 tablet_replica.cc:439] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } } }
I20260812 06:13:39.500391 14254 tablet_replica.cc:442] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:39.637620 14254 raft_consensus.cc:482] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:39.637742 14254 raft_consensus.cc:504] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.638218 14254 leader_election.cc:288] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a023f27f2f02414a8488452cb9827e6b (127.0.176.194:34455), 7ab47cff7d2f4973818072e18bf48945 (127.0.176.195:45883)
I20260812 06:13:39.641745 14237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.638491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:43787 (local address 127.0.176.194:34455)
0812 06:13:39.638544 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.638547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.638682 (+ 135us) server_negotiation.cc:407] Connection header received
0812 06:13:39.638778 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.638779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.638789 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.638864 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:39.639053 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.639785 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.640949 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.641346 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.641442 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.641452 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.641624 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.641670 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:13:39.641772 14313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.638452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:34455 (local address 127.0.176.193:43787)
0812 06:13:39.638592 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.638603 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.638700 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.638870 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.638871 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.638873 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:39.638956 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.638973 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.639875 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.639876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.640850 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.640853 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.641444 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.641445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.641536 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.641540 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.641604 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.641650 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":4,"thread_start_us":71,"threads_started":1}
I20260812 06:13:39.641860 14240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.638639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:41177 (local address 127.0.176.195:45883)
0812 06:13:39.638708 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.638710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.638799 (+ 89us) server_negotiation.cc:407] Connection header received
0812 06:13:39.638916 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.638917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.638927 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.639005 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:13:39.639193 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.639964 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.641098 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.641480 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.641570 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.641578 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.641746 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.641787 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:13:39.641885 14314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.638536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:45883 (local address 127.0.176.193:41177)
0812 06:13:39.638713 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.638723 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.638816 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.639009 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.639010 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.639013 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:13:39.639125 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.639127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.640048 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.640050 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.641008 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.641011 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.641570 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.641571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.641646 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.641651 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.641726 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.641769 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":2,"thread_start_us":111,"threads_started":1}
I20260812 06:13:39.642095 14126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3930df5f7dd04d4d94ba7c0cce7b161b" candidate_uuid: "280c98ce309c4d838d50530d83b263e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab47cff7d2f4973818072e18bf48945" is_pre_election: true
I20260812 06:13:39.642196 14126 raft_consensus.cc:2454] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 280c98ce309c4d838d50530d83b263e8 in term 0.
I20260812 06:13:39.642380 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3930df5f7dd04d4d94ba7c0cce7b161b" candidate_uuid: "280c98ce309c4d838d50530d83b263e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a023f27f2f02414a8488452cb9827e6b" is_pre_election: true
I20260812 06:13:39.642488 13880 raft_consensus.cc:2454] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 280c98ce309c4d838d50530d83b263e8 in term 0.
I20260812 06:13:39.642506 13478 leader_election.cc:302] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 280c98ce309c4d838d50530d83b263e8, 7ab47cff7d2f4973818072e18bf48945; no voters:
I20260812 06:13:39.642673 14254 raft_consensus.cc:2781] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:39.642725 14254 raft_consensus.cc:482] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:39.642762 14254 raft_consensus.cc:3037] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:39.643611 14254 raft_consensus.cc:504] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.643777 14254 leader_election.cc:288] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [CANDIDATE]: Term 1 election: Requested vote from peers a023f27f2f02414a8488452cb9827e6b (127.0.176.194:34455), 7ab47cff7d2f4973818072e18bf48945 (127.0.176.195:45883)
I20260812 06:13:39.643931 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3930df5f7dd04d4d94ba7c0cce7b161b" candidate_uuid: "280c98ce309c4d838d50530d83b263e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a023f27f2f02414a8488452cb9827e6b"
I20260812 06:13:39.643955 14126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3930df5f7dd04d4d94ba7c0cce7b161b" candidate_uuid: "280c98ce309c4d838d50530d83b263e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab47cff7d2f4973818072e18bf48945"
I20260812 06:13:39.644033 13880 raft_consensus.cc:3037] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:39.644037 14126 raft_consensus.cc:3037] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:39.644724 14126 raft_consensus.cc:2454] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 280c98ce309c4d838d50530d83b263e8 in term 1.
I20260812 06:13:39.644733 13880 raft_consensus.cc:2454] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 280c98ce309c4d838d50530d83b263e8 in term 1.
I20260812 06:13:39.644888 13478 leader_election.cc:302] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 280c98ce309c4d838d50530d83b263e8, 7ab47cff7d2f4973818072e18bf48945; no voters:
I20260812 06:13:39.644996 14254 raft_consensus.cc:2781] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:39.645164 14254 raft_consensus.cc:686] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [term 1 LEADER]: Becoming Leader. State: Replica: 280c98ce309c4d838d50530d83b263e8, State: Running, Role: LEADER
I20260812 06:13:39.645262 14254 consensus_queue.cc:237] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.645658 14315 tablet_replica.cc:439] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8: TxnStatusTablet state changed. Reason: New leader 280c98ce309c4d838d50530d83b263e8. Latest consensus state: current_term: 1 leader_uuid: "280c98ce309c4d838d50530d83b263e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } } }
I20260812 06:13:39.645774 14315 tablet_replica.cc:442] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:13:39.646005 14317 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:13:39.646132 14317 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 06:13:39.646101 13318 catalog_manager.cc:5495] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 280c98ce309c4d838d50530d83b263e8 (127.0.176.193). New cstate: current_term: 1 leader_uuid: "280c98ce309c4d838d50530d83b263e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } health_report { overall_health: UNKNOWN } } }
I20260812 06:13:39.684947 14236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.681910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52520 (local address 127.0.176.193:43173)
0812 06:13:39.681982 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.681984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.681996 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:13:39.682082 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.682083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.682107 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.682165 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:39.682322 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.682794 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.684008 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.684199 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.684259 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.684498 (+ 239us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:39.684638 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:39.684707 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.684820 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.684848 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 06:13:39.684959 14306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.681816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:43173 (local address 127.0.0.1:52520)
0812 06:13:39.681907 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.681942 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.682001 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.682191 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.682191 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.682193 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:13:39.682256 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.682259 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.682881 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.682883 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.683898 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.683909 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.684286 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.684288 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.684364 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.684392 (+ 28us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:13:39.684724 (+ 332us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:13:39.684743 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.684802 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.684865 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 06:13:39.686609 14126 raft_consensus.cc:1261] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Refusing update from remote peer 280c98ce309c4d838d50530d83b263e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:39.686944 13880 raft_consensus.cc:1261] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Refusing update from remote peer 280c98ce309c4d838d50530d83b263e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:39.687112 14315 consensus_queue.cc:1035] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:39.687237 14254 consensus_queue.cc:1035] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:39.687975 14283 tablet_replica.cc:439] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b: TxnStatusTablet state changed. Reason: New leader 280c98ce309c4d838d50530d83b263e8. Latest consensus state: current_term: 1 leader_uuid: "280c98ce309c4d838d50530d83b263e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } } }
I20260812 06:13:39.688097 14283 tablet_replica.cc:442] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:39.688372 14255 tablet_replica.cc:439] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945: TxnStatusTablet state changed. Reason: New leader 280c98ce309c4d838d50530d83b263e8. Latest consensus state: current_term: 1 leader_uuid: "280c98ce309c4d838d50530d83b263e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } } }
I20260812 06:13:39.688472 14255 tablet_replica.cc:442] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:39.689145 14254 tablet_replica.cc:439] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "280c98ce309c4d838d50530d83b263e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } } }
I20260812 06:13:39.689257 14254 tablet_replica.cc:442] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:13:39.689358 14254 tablet_replica.cc:439] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "280c98ce309c4d838d50530d83b263e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } } }
I20260812 06:13:39.689425 14254 tablet_replica.cc:442] T 3930df5f7dd04d4d94ba7c0cce7b161b P 280c98ce309c4d838d50530d83b263e8: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:13:39.689463 14283 tablet_replica.cc:439] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "280c98ce309c4d838d50530d83b263e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } } }
I20260812 06:13:39.689553 14283 tablet_replica.cc:442] T 3930df5f7dd04d4d94ba7c0cce7b161b P a023f27f2f02414a8488452cb9827e6b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:39.689555 14272 mvcc.cc:205] Tried to move back new op lower bound from 7317566339833851904 to 7317566339667587072. Current Snapshot: MvccSnapshot[applied={T|T < 7317566339833851904}]
I20260812 06:13:39.689621 14269 mvcc.cc:205] Tried to move back new op lower bound from 7317566339833851904 to 7317566339667587072. Current Snapshot: MvccSnapshot[applied={T|T < 7317566339833851904}]
I20260812 06:13:39.689656 14255 tablet_replica.cc:439] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "280c98ce309c4d838d50530d83b263e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } } }
I20260812 06:13:39.689720 14255 tablet_replica.cc:442] T 3930df5f7dd04d4d94ba7c0cce7b161b P 7ab47cff7d2f4973818072e18bf48945: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:13:39.693864 14240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.691480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49306 (local address 127.0.176.195:45883)
0812 06:13:39.691529 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.691531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.691538 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:13:39.691579 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.691580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.691600 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.691677 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:39.691800 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.692282 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.693041 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.693254 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.693334 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.693474 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:39.693599 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:39.693686 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.693734 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.693759 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:13:39.699510 14236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.696771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:46641 (local address 127.0.176.193:43173)
0812 06:13:39.696827 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.696829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.696919 (+ 90us) server_negotiation.cc:407] Connection header received
0812 06:13:39.696954 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.696955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.696980 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.697054 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:39.697156 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.697909 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.698655 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.698987 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.699063 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.699219 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:39.699257 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:39.699313 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.699359 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.699417 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:13:39.699780 14326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.696679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:43173 (local address 127.0.176.195:46641)
0812 06:13:39.696833 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.696844 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.696912 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.697054 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.697055 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.697056 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:13:39.697116 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.697117 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.697996 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.697997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.698563 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.698564 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.699069 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.699070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.699121 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.699137 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:13:39.699319 (+ 182us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:13:39.699320 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.699356 (+ 36us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.699453 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260812 06:13:39.702690 13604 raft_consensus.cc:1261] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Refusing update from remote peer 7ab47cff7d2f4973818072e18bf48945: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:39.702701 13880 raft_consensus.cc:1261] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Refusing update from remote peer 7ab47cff7d2f4973818072e18bf48945: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:39.702967 14255 consensus_queue.cc:1035] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:39.703120 14298 consensus_queue.cc:1035] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [LEADER]: Connected to new peer: Peer: permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:39.713440 14334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.710350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:45883 (local address 127.0.176.193:39203)
0812 06:13:39.710548 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:39.710560 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:39.710623 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:39.710753 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:39.710753 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:39.710755 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:13:39.710801 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.710802 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.711734 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.711735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.712589 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:39.712593 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.713058 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.713059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:39.713098 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.713114 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:13:39.713294 (+ 180us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:13:39.713296 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:13:39.713331 (+ 35us) client_negotiation.cc:240] Negotiation successful
0812 06:13:39.713368 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":122,"threads_started":1}
I20260812 06:13:39.713443 14240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.710394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:39203 (local address 127.0.176.195:45883)
0812 06:13:39.710453 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.710456 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.710632 (+ 176us) server_negotiation.cc:407] Connection header received
0812 06:13:39.710662 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.710663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.710674 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.710749 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:39.710842 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.711644 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.712671 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.712977 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.713055 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.713193 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:39.713229 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:39.713287 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.713335 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.713358 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:13:39.723453 13318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:39.723613 13318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:39.724344 13318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51: Sending DeleteTablet for 3 replicas of tablet 8b58cd4d85444d3b80f82437dab269df
I20260812 06:13:39.724661 13837 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b58cd4d85444d3b80f82437dab269df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:39 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:47532
I20260812 06:13:39.724680 14095 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b58cd4d85444d3b80f82437dab269df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:39 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:49304
I20260812 06:13:39.724782 14292 tablet_replica.cc:330] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945: stopping tablet replica
I20260812 06:13:39.724778 14290 tablet_replica.cc:330] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b: stopping tablet replica
I20260812 06:13:39.724849 14290 raft_consensus.cc:2229] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:39.724843 14292 raft_consensus.cc:2229] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:13:39.724906 14290 raft_consensus.cc:2258] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:39.724954 14292 raft_consensus.cc:2258] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:39.725466 14290 ts_tablet_manager.cc:1905] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:39.727252 14290 ts_tablet_manager.cc:1918] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:39.727313 14290 log.cc:1196] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/8b58cd4d85444d3b80f82437dab269df
I20260812 06:13:39.727586 14290 ts_tablet_manager.cc:1939] T 8b58cd4d85444d3b80f82437dab269df P a023f27f2f02414a8488452cb9827e6b: Deleting consensus metadata
I20260812 06:13:39.727818 14292 ts_tablet_manager.cc:1905] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:39.728045 13296 catalog_manager.cc:4841] TS a023f27f2f02414a8488452cb9827e6b (127.0.176.194:34455): tablet 8b58cd4d85444d3b80f82437dab269df (table test-table [id=17b53ea1ab8b4f8093ba7499447eeb45]) successfully deleted
I20260812 06:13:39.729532 14292 ts_tablet_manager.cc:1918] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:39.729591 14292 log.cc:1196] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/8b58cd4d85444d3b80f82437dab269df
I20260812 06:13:39.729812 14292 ts_tablet_manager.cc:1939] T 8b58cd4d85444d3b80f82437dab269df P 7ab47cff7d2f4973818072e18bf48945: Deleting consensus metadata
I20260812 06:13:39.730281 13297 catalog_manager.cc:4841] TS 7ab47cff7d2f4973818072e18bf48945 (127.0.176.195:45883): tablet 8b58cd4d85444d3b80f82437dab269df (table test-table [id=17b53ea1ab8b4f8093ba7499447eeb45]) successfully deleted
I20260812 06:13:39.730383 13571 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b58cd4d85444d3b80f82437dab269df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:39 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:52516
I20260812 06:13:39.730494 14291 tablet_replica.cc:330] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8: stopping tablet replica
I20260812 06:13:39.730547 14291 raft_consensus.cc:2229] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:39.730579 14291 raft_consensus.cc:2258] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:39.733881 14291 ts_tablet_manager.cc:1905] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:39.735795 14291 ts_tablet_manager.cc:1918] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:39.735879 14291 log.cc:1196] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/wal/wals/8b58cd4d85444d3b80f82437dab269df
I20260812 06:13:39.736119 14291 ts_tablet_manager.cc:1939] T 8b58cd4d85444d3b80f82437dab269df P 280c98ce309c4d838d50530d83b263e8: Deleting consensus metadata
I20260812 06:13:39.736835 13297 catalog_manager.cc:4841] TS 280c98ce309c4d838d50530d83b263e8 (127.0.176.193:43173): tablet 8b58cd4d85444d3b80f82437dab269df (table test-table [id=17b53ea1ab8b4f8093ba7499447eeb45]) successfully deleted
Aug 12 06:13:39 dist-test-slave-gw5c krb5kdc[13240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:13:39 dist-test-slave-gw5c krb5kdc[13240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:39 dist-test-slave-gw5c krb5kdc[13240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:13:39.763887 13408 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:39.756470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40728 (local address 127.0.176.254:43055)
0812 06:13:39.756526 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.756529 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.756698 (+ 169us) server_negotiation.cc:407] Connection header received
0812 06:13:39.756816 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.756817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.756831 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.756902 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:39.757655 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.758439 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.759620 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.759947 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.759990 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.763816 (+ 3826us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40728: BlockingRecv error: recv got EOF from 127.0.0.1:40728 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 12 06:13:39 dist-test-slave-gw5c krb5kdc[13240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM
I20260812 06:13:39.777252 13408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.764807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40730 (local address 127.0.176.254:43055)
0812 06:13:39.764851 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.764853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.764992 (+ 139us) server_negotiation.cc:407] Connection header received
0812 06:13:39.765048 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.765049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.765060 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.765123 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:39.768496 (+ 3373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.769312 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.770505 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.770849 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.770925 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.774119 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:39.774120 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:39.774121 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:39.774129 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:39.775902 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:39.776356 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:39.776357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:39.776358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:39.776428 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:39.776657 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:39.776658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:39.776658 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:39.776803 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:39.776901 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.777063 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.777148 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:13:39.778955 13318 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40730:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:13:39.779165 13318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:39.781219 13837 tablet_service.cc:1467] Processing CreateTablet for tablet 7ff1a03a01ca473a988f46af32f8f6c0 (DEFAULT_TABLE table=test-table [id=bc4c308f9dc9413ebf19e1d9ba4cf73c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:39.781213 14095 tablet_service.cc:1467] Processing CreateTablet for tablet 7ff1a03a01ca473a988f46af32f8f6c0 (DEFAULT_TABLE table=test-table [id=bc4c308f9dc9413ebf19e1d9ba4cf73c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:39.781379 14095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ff1a03a01ca473a988f46af32f8f6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.781389 13837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ff1a03a01ca473a988f46af32f8f6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.782828 13571 tablet_service.cc:1467] Processing CreateTablet for tablet 7ff1a03a01ca473a988f46af32f8f6c0 (DEFAULT_TABLE table=test-table [id=bc4c308f9dc9413ebf19e1d9ba4cf73c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:39.782963 13571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ff1a03a01ca473a988f46af32f8f6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.783526 14245 tablet_bootstrap.cc:492] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945: Bootstrap starting.
I20260812 06:13:39.784008 14245 tablet_bootstrap.cc:654] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.784379 14246 tablet_bootstrap.cc:492] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b: Bootstrap starting.
I20260812 06:13:39.784384 14243 tablet_bootstrap.cc:492] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8: Bootstrap starting.
I20260812 06:13:39.784752 14246 tablet_bootstrap.cc:654] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.784804 14243 tablet_bootstrap.cc:654] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.785612 14245 tablet_bootstrap.cc:492] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945: No bootstrap required, opened a new log
I20260812 06:13:39.785667 14245 ts_tablet_manager.cc:1397] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:13:39.785800 14246 tablet_bootstrap.cc:492] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b: No bootstrap required, opened a new log
I20260812 06:13:39.785851 14246 ts_tablet_manager.cc:1397] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:39.785813 14245 raft_consensus.cc:348] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.785887 14245 raft_consensus.cc:374] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.785909 14245 raft_consensus.cc:729] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab47cff7d2f4973818072e18bf48945, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.785951 14245 consensus_queue.cc:260] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.785977 14246 raft_consensus.cc:348] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.786044 14246 raft_consensus.cc:374] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.786047 14245 ts_tablet_manager.cc:1428] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:39.786064 14246 raft_consensus.cc:729] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a023f27f2f02414a8488452cb9827e6b, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.786106 14246 consensus_queue.cc:260] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.786201 14246 ts_tablet_manager.cc:1428] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:39.786844 14243 tablet_bootstrap.cc:492] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8: No bootstrap required, opened a new log
I20260812 06:13:39.786907 14243 ts_tablet_manager.cc:1397] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260812 06:13:39.787066 14243 raft_consensus.cc:348] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.787142 14243 raft_consensus.cc:374] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.787163 14243 raft_consensus.cc:729] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 280c98ce309c4d838d50530d83b263e8, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.787202 14243 consensus_queue.cc:260] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.787304 14243 ts_tablet_manager.cc:1428] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:39.940069 14298 raft_consensus.cc:482] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:39.940220 14298 raft_consensus.cc:504] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.940465 14298 leader_election.cc:288] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 280c98ce309c4d838d50530d83b263e8 (127.0.176.193:43173), a023f27f2f02414a8488452cb9827e6b (127.0.176.194:34455)
I20260812 06:13:39.940750 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ff1a03a01ca473a988f46af32f8f6c0" candidate_uuid: "7ab47cff7d2f4973818072e18bf48945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a023f27f2f02414a8488452cb9827e6b" is_pre_election: true
I20260812 06:13:39.940752 13604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ff1a03a01ca473a988f46af32f8f6c0" candidate_uuid: "7ab47cff7d2f4973818072e18bf48945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "280c98ce309c4d838d50530d83b263e8" is_pre_election: true
I20260812 06:13:39.940852 13880 raft_consensus.cc:2454] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab47cff7d2f4973818072e18bf48945 in term 0.
I20260812 06:13:39.940871 13604 raft_consensus.cc:2454] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab47cff7d2f4973818072e18bf48945 in term 0.
I20260812 06:13:39.941025 14015 leader_election.cc:302] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab47cff7d2f4973818072e18bf48945, a023f27f2f02414a8488452cb9827e6b; no voters:
I20260812 06:13:39.941113 14298 raft_consensus.cc:2781] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:39.941155 14298 raft_consensus.cc:482] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:39.941184 14298 raft_consensus.cc:3037] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:39.941956 14298 raft_consensus.cc:504] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.942118 14298 leader_election.cc:288] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [CANDIDATE]: Term 1 election: Requested vote from peers 280c98ce309c4d838d50530d83b263e8 (127.0.176.193:43173), a023f27f2f02414a8488452cb9827e6b (127.0.176.194:34455)
I20260812 06:13:39.942301 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ff1a03a01ca473a988f46af32f8f6c0" candidate_uuid: "7ab47cff7d2f4973818072e18bf48945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a023f27f2f02414a8488452cb9827e6b"
I20260812 06:13:39.942299 13604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ff1a03a01ca473a988f46af32f8f6c0" candidate_uuid: "7ab47cff7d2f4973818072e18bf48945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "280c98ce309c4d838d50530d83b263e8"
I20260812 06:13:39.942390 13880 raft_consensus.cc:3037] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:39.942503 13604 raft_consensus.cc:3037] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:39.943094 13880 raft_consensus.cc:2454] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab47cff7d2f4973818072e18bf48945 in term 1.
I20260812 06:13:39.943292 13604 raft_consensus.cc:2454] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab47cff7d2f4973818072e18bf48945 in term 1.
I20260812 06:13:39.943305 14015 leader_election.cc:302] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab47cff7d2f4973818072e18bf48945, a023f27f2f02414a8488452cb9827e6b; no voters:
I20260812 06:13:39.943411 14298 raft_consensus.cc:2781] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:39.943472 14298 raft_consensus.cc:686] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [term 1 LEADER]: Becoming Leader. State: Replica: 7ab47cff7d2f4973818072e18bf48945, State: Running, Role: LEADER
I20260812 06:13:39.943532 14298 consensus_queue.cc:237] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.944360 13318 catalog_manager.cc:5495] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ab47cff7d2f4973818072e18bf48945 (127.0.176.195). New cstate: current_term: 1 leader_uuid: "7ab47cff7d2f4973818072e18bf48945" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } health_report { overall_health: HEALTHY } } }
I20260812 06:13:39.973345 14240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:39.970943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49318 (local address 127.0.176.195:45883)
0812 06:13:39.971012 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:39.971014 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:39.971024 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:39.971052 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:39.971053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:39.971064 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:39.971115 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:13:39.971298 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.971802 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.972589 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:39.972800 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:39.972883 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:39.973056 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:13:39.973098 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:13:39.973160 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:39.973224 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 06:13:39.973257 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 06:13:39.974319 13604 raft_consensus.cc:1261] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Refusing update from remote peer 7ab47cff7d2f4973818072e18bf48945: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:39.974319 13880 raft_consensus.cc:1261] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Refusing update from remote peer 7ab47cff7d2f4973818072e18bf48945: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:39.974568 14332 consensus_queue.cc:1035] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [LEADER]: Connected to new peer: Peer: permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:39.974792 14332 consensus_queue.cc:1035] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:39.977401 13319 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:39.977494 13319 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:39.978155 13319 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51: Sending DeleteTablet for 3 replicas of tablet 7ff1a03a01ca473a988f46af32f8f6c0
I20260812 06:13:39.978449 14095 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff1a03a01ca473a988f46af32f8f6c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:39 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:49304
I20260812 06:13:39.978436 13837 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff1a03a01ca473a988f46af32f8f6c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:39 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:47532
I20260812 06:13:39.978432 13571 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ff1a03a01ca473a988f46af32f8f6c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:39 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:52516
I20260812 06:13:39.978547 14290 tablet_replica.cc:330] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b: stopping tablet replica
I20260812 06:13:39.978566 14291 tablet_replica.cc:330] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8: stopping tablet replica
I20260812 06:13:39.978607 14290 raft_consensus.cc:2229] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:39.978634 14291 raft_consensus.cc:2229] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:39.978655 14290 raft_consensus.cc:2258] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:39.978688 14291 raft_consensus.cc:2258] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:39.978747 14292 tablet_replica.cc:330] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945: stopping tablet replica
I20260812 06:13:39.978801 14292 raft_consensus.cc:2229] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:13:39.978858 14292 raft_consensus.cc:2258] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:39.979010 14291 ts_tablet_manager.cc:1905] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:39.979203 14292 ts_tablet_manager.cc:1905] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:39.979234 14290 ts_tablet_manager.cc:1905] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:39.980614 14290 ts_tablet_manager.cc:1918] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:39.980669 14292 ts_tablet_manager.cc:1918] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:39.980685 14290 log.cc:1196] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/7ff1a03a01ca473a988f46af32f8f6c0
I20260812 06:13:39.980724 14291 ts_tablet_manager.cc:1918] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:13:39.980726 14292 log.cc:1196] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/7ff1a03a01ca473a988f46af32f8f6c0
I20260812 06:13:39.980787 14291 log.cc:1196] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/wal/wals/7ff1a03a01ca473a988f46af32f8f6c0
I20260812 06:13:39.980757 13319 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40730:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:13:39.980924 13319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:13:39.980947 14290 ts_tablet_manager.cc:1939] T 7ff1a03a01ca473a988f46af32f8f6c0 P a023f27f2f02414a8488452cb9827e6b: Deleting consensus metadata
I20260812 06:13:39.980970 14292 ts_tablet_manager.cc:1939] T 7ff1a03a01ca473a988f46af32f8f6c0 P 7ab47cff7d2f4973818072e18bf48945: Deleting consensus metadata
I20260812 06:13:39.980997 14291 ts_tablet_manager.cc:1939] T 7ff1a03a01ca473a988f46af32f8f6c0 P 280c98ce309c4d838d50530d83b263e8: Deleting consensus metadata
I20260812 06:13:39.981292 13296 catalog_manager.cc:4841] TS a023f27f2f02414a8488452cb9827e6b (127.0.176.194:34455): tablet 7ff1a03a01ca473a988f46af32f8f6c0 (table test-table [id=bc4c308f9dc9413ebf19e1d9ba4cf73c]) successfully deleted
I20260812 06:13:39.981683 13297 catalog_manager.cc:4841] TS 280c98ce309c4d838d50530d83b263e8 (127.0.176.193:43173): tablet 7ff1a03a01ca473a988f46af32f8f6c0 (table test-table [id=bc4c308f9dc9413ebf19e1d9ba4cf73c]) successfully deleted
I20260812 06:13:39.981844 13297 catalog_manager.cc:4841] TS 7ab47cff7d2f4973818072e18bf48945 (127.0.176.195:45883): tablet 7ff1a03a01ca473a988f46af32f8f6c0 (table test-table [id=bc4c308f9dc9413ebf19e1d9ba4cf73c]) successfully deleted
I20260812 06:13:39.982343 14095 tablet_service.cc:1467] Processing CreateTablet for tablet d9082853b0d141999d9328fa1606d9e0 (DEFAULT_TABLE table=test-table [id=cb0e639401ed4665af9af1cf0db8dfea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:39.982334 13837 tablet_service.cc:1467] Processing CreateTablet for tablet d9082853b0d141999d9328fa1606d9e0 (DEFAULT_TABLE table=test-table [id=cb0e639401ed4665af9af1cf0db8dfea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:39.982337 13571 tablet_service.cc:1467] Processing CreateTablet for tablet d9082853b0d141999d9328fa1606d9e0 (DEFAULT_TABLE table=test-table [id=cb0e639401ed4665af9af1cf0db8dfea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:13:39.982458 13837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9082853b0d141999d9328fa1606d9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.982460 14095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9082853b0d141999d9328fa1606d9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.982481 13571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9082853b0d141999d9328fa1606d9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:39.983323 14243 tablet_bootstrap.cc:492] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8: Bootstrap starting.
I20260812 06:13:39.983695 14243 tablet_bootstrap.cc:654] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.983769 14246 tablet_bootstrap.cc:492] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b: Bootstrap starting.
I20260812 06:13:39.983848 14245 tablet_bootstrap.cc:492] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945: Bootstrap starting.
I20260812 06:13:39.984097 14246 tablet_bootstrap.cc:654] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.984174 14245 tablet_bootstrap.cc:654] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:39.984390 14243 tablet_bootstrap.cc:492] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8: No bootstrap required, opened a new log
I20260812 06:13:39.984443 14243 ts_tablet_manager.cc:1397] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:39.984579 14243 raft_consensus.cc:348] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.984661 14246 tablet_bootstrap.cc:492] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b: No bootstrap required, opened a new log
I20260812 06:13:39.984670 14243 raft_consensus.cc:374] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.984695 14243 raft_consensus.cc:729] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 280c98ce309c4d838d50530d83b263e8, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.984705 14246 ts_tablet_manager.cc:1397] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 06:13:39.984754 14243 consensus_queue.cc:260] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.984803 14246 raft_consensus.cc:348] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.984862 14243 ts_tablet_manager.cc:1428] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 06:13:39.984872 14246 raft_consensus.cc:374] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.984896 14246 raft_consensus.cc:729] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a023f27f2f02414a8488452cb9827e6b, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.984943 14246 consensus_queue.cc:260] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.985059 14246 ts_tablet_manager.cc:1428] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:39.985514 14245 tablet_bootstrap.cc:492] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945: No bootstrap required, opened a new log
I20260812 06:13:39.985574 14245 ts_tablet_manager.cc:1397] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:13:39.985731 14245 raft_consensus.cc:348] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.985808 14245 raft_consensus.cc:374] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:39.985850 14245 raft_consensus.cc:729] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab47cff7d2f4973818072e18bf48945, State: Initialized, Role: FOLLOWER
I20260812 06:13:39.985886 14245 consensus_queue.cc:260] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:39.985984 14245 ts_tablet_manager.cc:1428] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:40.038617 14332 raft_consensus.cc:482] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:13:40.038739 14332 raft_consensus.cc:504] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:40.039004 14332 leader_election.cc:288] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 280c98ce309c4d838d50530d83b263e8 (127.0.176.193:43173), a023f27f2f02414a8488452cb9827e6b (127.0.176.194:34455)
I20260812 06:13:40.039302 13604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9082853b0d141999d9328fa1606d9e0" candidate_uuid: "7ab47cff7d2f4973818072e18bf48945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "280c98ce309c4d838d50530d83b263e8" is_pre_election: true
I20260812 06:13:40.039300 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9082853b0d141999d9328fa1606d9e0" candidate_uuid: "7ab47cff7d2f4973818072e18bf48945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a023f27f2f02414a8488452cb9827e6b" is_pre_election: true
I20260812 06:13:40.039454 13880 raft_consensus.cc:2454] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab47cff7d2f4973818072e18bf48945 in term 0.
I20260812 06:13:40.039458 13604 raft_consensus.cc:2454] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab47cff7d2f4973818072e18bf48945 in term 0.
I20260812 06:13:40.039659 14015 leader_election.cc:302] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab47cff7d2f4973818072e18bf48945, a023f27f2f02414a8488452cb9827e6b; no voters:
I20260812 06:13:40.039745 14332 raft_consensus.cc:2781] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:13:40.039798 14332 raft_consensus.cc:482] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:13:40.039824 14332 raft_consensus.cc:3037] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:40.040817 14332 raft_consensus.cc:504] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:40.040968 14332 leader_election.cc:288] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [CANDIDATE]: Term 1 election: Requested vote from peers 280c98ce309c4d838d50530d83b263e8 (127.0.176.193:43173), a023f27f2f02414a8488452cb9827e6b (127.0.176.194:34455)
I20260812 06:13:40.041133 13604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9082853b0d141999d9328fa1606d9e0" candidate_uuid: "7ab47cff7d2f4973818072e18bf48945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "280c98ce309c4d838d50530d83b263e8"
I20260812 06:13:40.041219 13604 raft_consensus.cc:3037] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:40.041561 13880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9082853b0d141999d9328fa1606d9e0" candidate_uuid: "7ab47cff7d2f4973818072e18bf48945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a023f27f2f02414a8488452cb9827e6b"
I20260812 06:13:40.041648 13880 raft_consensus.cc:3037] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:40.042099 13604 raft_consensus.cc:2454] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab47cff7d2f4973818072e18bf48945 in term 1.
I20260812 06:13:40.042299 14018 leader_election.cc:302] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 280c98ce309c4d838d50530d83b263e8, 7ab47cff7d2f4973818072e18bf48945; no voters:
I20260812 06:13:40.042457 14332 raft_consensus.cc:2781] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:40.042503 14332 raft_consensus.cc:686] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [term 1 LEADER]: Becoming Leader. State: Replica: 7ab47cff7d2f4973818072e18bf48945, State: Running, Role: LEADER
I20260812 06:13:40.042548 14332 consensus_queue.cc:237] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } }
I20260812 06:13:40.043352 13880 raft_consensus.cc:2454] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab47cff7d2f4973818072e18bf48945 in term 1.
I20260812 06:13:40.043251 13318 catalog_manager.cc:5495] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ab47cff7d2f4973818072e18bf48945 (127.0.176.195). New cstate: current_term: 1 leader_uuid: "7ab47cff7d2f4973818072e18bf48945" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab47cff7d2f4973818072e18bf48945" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 45883 } health_report { overall_health: HEALTHY } } }
I20260812 06:13:40.056519 13880 raft_consensus.cc:1261] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Refusing update from remote peer 7ab47cff7d2f4973818072e18bf48945: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:40.056515 13604 raft_consensus.cc:1261] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Refusing update from remote peer 7ab47cff7d2f4973818072e18bf48945: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:13:40.056874 14298 consensus_queue.cc:1035] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a023f27f2f02414a8488452cb9827e6b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:40.057006 14332 consensus_queue.cc:1035] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [LEADER]: Connected to new peer: Peer: permanent_uuid: "280c98ce309c4d838d50530d83b263e8" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 43173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:13:40.069300 13318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:40.069438 13318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:13:40.070168 13318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d0f4d68e18ce40bea214e3b5634e9d51: Sending DeleteTablet for 3 replicas of tablet d9082853b0d141999d9328fa1606d9e0
I20260812 06:13:40.070464 13837 tablet_service.cc:1514] Processing DeleteTablet for tablet d9082853b0d141999d9328fa1606d9e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:40 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:47532
I20260812 06:13:40.070605 14290 tablet_replica.cc:330] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b: stopping tablet replica
I20260812 06:13:40.070616 13571 tablet_service.cc:1514] Processing DeleteTablet for tablet d9082853b0d141999d9328fa1606d9e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:40 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:52516
I20260812 06:13:40.070693 14290 raft_consensus.cc:2229] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:40.070736 14290 raft_consensus.cc:2258] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:40.070721 14291 tablet_replica.cc:330] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8: stopping tablet replica
I20260812 06:13:40.070801 14291 raft_consensus.cc:2229] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:13:40.070847 14291 raft_consensus.cc:2258] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:40.070920 14095 tablet_service.cc:1514] Processing DeleteTablet for tablet d9082853b0d141999d9328fa1606d9e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:13:40 UTC) from {username='oryx', principal='oryx/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:49304
I20260812 06:13:40.071003 14292 tablet_replica.cc:330] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945: stopping tablet replica
I20260812 06:13:40.071048 14292 raft_consensus.cc:2229] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:13:40.071105 14292 raft_consensus.cc:2258] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:13:40.075526 14290 ts_tablet_manager.cc:1905] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:40.075536 14292 ts_tablet_manager.cc:1905] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:40.075670 14291 ts_tablet_manager.cc:1905] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:13:40.076954 14290 ts_tablet_manager.cc:1918] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:40.077098 14290 log.cc:1196] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/d9082853b0d141999d9328fa1606d9e0
I20260812 06:13:40.077206 14292 ts_tablet_manager.cc:1918] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:40.077260 14291 ts_tablet_manager.cc:1918] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:13:40.077282 14292 log.cc:1196] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/d9082853b0d141999d9328fa1606d9e0
I20260812 06:13:40.077314 14291 log.cc:1196] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515178947866-707-0/minicluster-data/ts-0/wal/wals/d9082853b0d141999d9328fa1606d9e0
I20260812 06:13:40.077397 14290 ts_tablet_manager.cc:1939] T d9082853b0d141999d9328fa1606d9e0 P a023f27f2f02414a8488452cb9827e6b: Deleting consensus metadata
I20260812 06:13:40.077515 14292 ts_tablet_manager.cc:1939] T d9082853b0d141999d9328fa1606d9e0 P 7ab47cff7d2f4973818072e18bf48945: Deleting consensus metadata
I20260812 06:13:40.077557 14291 ts_tablet_manager.cc:1939] T d9082853b0d141999d9328fa1606d9e0 P 280c98ce309c4d838d50530d83b263e8: Deleting consensus metadata
I20260812 06:13:40.077836 13296 catalog_manager.cc:4841] TS a023f27f2f02414a8488452cb9827e6b (127.0.176.194:34455): tablet d9082853b0d141999d9328fa1606d9e0 (table test-table [id=cb0e639401ed4665af9af1cf0db8dfea]) successfully deleted
I20260812 06:13:40.077929 13297 catalog_manager.cc:4841] TS 280c98ce309c4d838d50530d83b263e8 (127.0.176.193:43173): tablet d9082853b0d141999d9328fa1606d9e0 (table test-table [id=cb0e639401ed4665af9af1cf0db8dfea]) successfully deleted
I20260812 06:13:40.078006 13297 catalog_manager.cc:4841] TS 7ab47cff7d2f4973818072e18bf48945 (127.0.176.195:45883): tablet d9082853b0d141999d9328fa1606d9e0 (table test-table [id=cb0e639401ed4665af9af1cf0db8dfea]) successfully deleted
I20260812 06:13:40.078270 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 13448
I20260812 06:13:40.097759 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 13702
I20260812 06:13:40.117564 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 13983
I20260812 06:13:40.132655 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 13263
2026-08-12T06:13:40Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3179 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:13:40 dist-test-slave-gw5c krb5kdc[14385](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:13:40 dist-test-slave-gw5c krb5kdc[14385](info): set up 2 sockets
Aug 12 06:13:40 dist-test-slave-gw5c krb5kdc[14385](info): commencing operation
krb5kdc: starting...
W20260812 06:13:41.412320 707 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:41 dist-test-slave-gw5c krb5kdc[14385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:13:41.544605 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:34295
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:32889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:34295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:41.633580 14406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:41.633842 14406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:41.633885 14406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:41.635104 14406 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:41.635183 14406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:41.635210 14406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:41.635237 14406 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:41.635267 14406 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:41.636858 14406 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:32889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:34295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:34295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:41.637144 14406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:41.637385 14406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:41.643008 14419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:41.642942 14421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:41.642997 14406 server_base.cc:1034] running on GCE node
W20260812 06:13:41.642956 14417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:41.643589 14406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:41.643898 14406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:41.645098 14406 hybrid_clock.cc:648] HybridClock initialized: now 1786515221645091 us; error 45 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T06:13:41Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1513 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:13:41 dist-test-slave-gw5c krb5kdc[14431](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:13:41 dist-test-slave-gw5c krb5kdc[14431](info): set up 2 sockets
Aug 12 06:13:41 dist-test-slave-gw5c krb5kdc[14431](info): commencing operation
krb5kdc: starting...
W20260812 06:13:42.947731 707 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:13:43 dist-test-slave-gw5c krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:13:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:13:43.082819 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:35323
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:35323
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:43.176116 14459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:43.176409 14459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:43.176451 14459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:43.177767 14459 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:43.177848 14459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:43.177886 14459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:43.177937 14459 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:43.177965 14459 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:43.179800 14459 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:35323
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:35323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:43.180117 14459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:43.180373 14459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:43.186448 14481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:43.186448 14470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:43.186493 14474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:43.186776 14459 server_base.cc:1034] running on GCE node
I20260812 06:13:43.187105 14459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:43.187515 14459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:43.188717 14459 hybrid_clock.cc:648] HybridClock initialized: now 1786515223188668 us; error 69 us; skew 500 ppm
Aug 12 06:13:43 dist-test-slave-gw5c krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515223, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:43.191818 14459 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:13:43.192785 14459 webserver.cc:460] Webserver started at http://127.0.176.254:41565/ using document root <none> and password file <none>
I20260812 06:13:43.193364 14459 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:43.193560 14459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:43.193746 14459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:43.195537 14459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "fa8939cac3e842ecad689d32f8fab127"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "39d4ab98e2295f0021d21efe6426bb01"
server_key_iv: "875d603e8ff883cf4fc74ab8c9460475"
server_key_version: "encryptionkey@0"
I20260812 06:13:43.195956 14459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "fa8939cac3e842ecad689d32f8fab127"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "39d4ab98e2295f0021d21efe6426bb01"
server_key_iv: "875d603e8ff883cf4fc74ab8c9460475"
server_key_version: "encryptionkey@0"
I20260812 06:13:43.197522 14459 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:43.198357 14490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:43.198573 14459 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:43.198684 14459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "fa8939cac3e842ecad689d32f8fab127"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "39d4ab98e2295f0021d21efe6426bb01"
server_key_iv: "875d603e8ff883cf4fc74ab8c9460475"
server_key_version: "encryptionkey@0"
I20260812 06:13:43.198776 14459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:43.217374 14459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:43.220139 14459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:43.220343 14459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:43.224742 14459 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:35323
I20260812 06:13:43.224782 14604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:35323 every 8 connection(s)
I20260812 06:13:43.225342 14459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:43.226150 14605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:43.228619 14605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127: Bootstrap starting.
I20260812 06:13:43.229257 14605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:43.229568 14605 log.cc:824] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:43.229787 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 14459
I20260812 06:13:43.229913 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:43.230170 707 external_mini_cluster.cc:1428] Setting key 13fe81b2c803752a0bf834d44e0c912b
I20260812 06:13:43.230515 14605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127: No bootstrap required, opened a new log
I20260812 06:13:43.233371 14605 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa8939cac3e842ecad689d32f8fab127" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35323 } }
I20260812 06:13:43.233592 14605 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:43.233649 14605 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8939cac3e842ecad689d32f8fab127, State: Initialized, Role: FOLLOWER
I20260812 06:13:43.233798 14605 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa8939cac3e842ecad689d32f8fab127" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35323 } }
I20260812 06:13:43.233879 14605 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:43.233904 14605 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:43.233971 14605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:43.234664 14605 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa8939cac3e842ecad689d32f8fab127" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35323 } }
I20260812 06:13:43.234809 14605 leader_election.cc:302] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa8939cac3e842ecad689d32f8fab127; no voters:
I20260812 06:13:43.235014 14605 leader_election.cc:288] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:43.235078 14614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:43.235301 14614 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 1 LEADER]: Becoming Leader. State: Replica: fa8939cac3e842ecad689d32f8fab127, State: Running, Role: LEADER
I20260812 06:13:43.235332 14605 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:43.235497 14614 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa8939cac3e842ecad689d32f8fab127" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35323 } }
I20260812 06:13:43.236837 14616 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa8939cac3e842ecad689d32f8fab127" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa8939cac3e842ecad689d32f8fab127" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35323 } } }
I20260812 06:13:43.237736 14616 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:43.237027 14615 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa8939cac3e842ecad689d32f8fab127. Latest consensus state: current_term: 1 leader_uuid: "fa8939cac3e842ecad689d32f8fab127" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa8939cac3e842ecad689d32f8fab127" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35323 } } }
I20260812 06:13:43.237907 14615 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [sys.catalog]: This master's current role is: LEADER
W20260812 06:13:43.237385 14640 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:13:43.237949 14640 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:13:43.238015 14648 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:43.238224 14648 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:43.239964 14648 catalog_manager.cc:1347] Generated new cluster ID: a645fafa423b4d9ba4706ce5158f8807
I20260812 06:13:43.240026 14648 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:13:43 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:43.244257 14612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:43.230813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35378 (local address 127.0.176.254:35323)
0812 06:13:43.231029 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:43.231038 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:43.231064 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:13:43.233240 (+ 2176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:43.233251 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:43.233318 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:43.233527 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:43.234370 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.235661 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.236895 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.237337 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.237473 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:43.240634 (+ 3161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:43.240639 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:43.240639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:43.240653 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:43.242474 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:43.242901 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:43.242911 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:43.242912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:43.243001 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:43.243219 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:43.243220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:43.243220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:43.243590 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:43.243771 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:43.243878 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 06:13:43.244035 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":100,"threads_started":1}
I20260812 06:13:43.249202 14648 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:43.249758 14648 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:43.253949 14648 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127: Generated new TSK 0
I20260812 06:13:43.254154 14648 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:13:43.290105 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:35323
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:43.396811 14654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:43.397063 14654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:43.397090 14654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:43.398388 14654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:43.398449 14654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:43.398480 14654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:43.400295 14654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:35323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:43.400599 14654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:43.400877 14654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:43.407032 14662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:43.407054 14663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:43.407100 14667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:43.407482 14654 server_base.cc:1034] running on GCE node
I20260812 06:13:43.407704 14654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:43.408020 14654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:43.409195 14654 hybrid_clock.cc:648] HybridClock initialized: now 1786515223409181 us; error 30 us; skew 500 ppm
Aug 12 06:13:43 dist-test-slave-gw5c krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515223, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:43.412279 14654 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:13:43.412827 14654 webserver.cc:460] Webserver started at http://127.0.176.193:33273/ using document root <none> and password file <none>
I20260812 06:13:43.413077 14654 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:43.413129 14654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:43.413275 14654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:43.414535 14654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "ec9db77f66de422c980cf6964e5a16fb"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "1386ab61b2f202cd6ee5a067333ea00e"
server_key_iv: "27498f5bb8ce0906ffe9bc0ee27365e9"
server_key_version: "encryptionkey@0"
I20260812 06:13:43.414928 14654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "ec9db77f66de422c980cf6964e5a16fb"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "1386ab61b2f202cd6ee5a067333ea00e"
server_key_iv: "27498f5bb8ce0906ffe9bc0ee27365e9"
server_key_version: "encryptionkey@0"
I20260812 06:13:43.416810 14654 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 06:13:43.417795 14681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:43.418036 14654 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:43.418136 14654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "ec9db77f66de422c980cf6964e5a16fb"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "1386ab61b2f202cd6ee5a067333ea00e"
server_key_iv: "27498f5bb8ce0906ffe9bc0ee27365e9"
server_key_version: "encryptionkey@0"
I20260812 06:13:43.418201 14654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:43.438213 14654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:43.441329 14654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:43.441483 14654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:43.441759 14654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:43.442131 14654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:43.442168 14654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:43.442193 14654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:43.442239 14654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:43.448362 14654 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:43035
I20260812 06:13:43.448454 14886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:43035 every 8 connection(s)
I20260812 06:13:43.448802 14654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:43.454882 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 14654
I20260812 06:13:43.454993 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:43.455205 707 external_mini_cluster.cc:1428] Setting key 39ac814b98d828e744cf8a4d19148a24
Aug 12 06:13:43 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515223, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:43.460024 14612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:43.449613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:35159 (local address 127.0.176.254:35323)
0812 06:13:43.449739 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:43.449742 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:43.449962 (+ 220us) server_negotiation.cc:407] Connection header received
0812 06:13:43.451055 (+ 1093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:43.451057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:43.451072 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:43.451128 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:43.451914 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.452448 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.453495 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.453721 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.453814 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:43.456490 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:43.456491 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:43.456491 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:43.456499 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:43.458356 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:43.458865 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:43.458867 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:43.458867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:43.458934 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:43.459198 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:43.459198 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:43.459199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:43.459370 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:43.459472 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:43.459773 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 06:13:43.459878 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 06:13:43.460069 14890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:43.449577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:35159)
0812 06:13:43.449801 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:43.449841 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:43.450927 (+ 1086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:43.451219 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:43.451223 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:43.451584 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:43.451792 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:43.451797 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.452555 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.452556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:43.453394 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:43.453396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.453829 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.453829 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:43.453970 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:43.454585 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:43.454595 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:43.456366 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:43.458471 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:43.458481 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:43.458484 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:43.458768 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:43.459022 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:43.459023 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:43.459023 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:43.459131 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:43.459483 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:43.459490 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:43.459627 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 06:13:43.459734 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 06:13:43.459886 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":97,"threads_started":1}
I20260812 06:13:43.460664 14888 heartbeater.cc:347] Connected to a master server at 127.0.176.254:35323
I20260812 06:13:43.460793 14888 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:43.461027 14888 heartbeater.cc:511] Master 127.0.176.254:35323 requested a full tablet report, sending...
I20260812 06:13:43.461622 14536 ts_manager.cc:194] Registered new tserver with Master: ec9db77f66de422c980cf6964e5a16fb (127.0.176.193:43035)
I20260812 06:13:43.462248 14536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:35159
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:13:43.482725 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:35323
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:43.568434 14894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:43.568667 14894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:43.568694 14894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:43.570216 14894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:43.570289 14894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:43.570358 14894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:43.572083 14894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:35323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:43.572377 14894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:43.572644 14894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:43.579057 14902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:43.579061 14912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:43.579057 14903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:43.579337 14894 server_base.cc:1034] running on GCE node
I20260812 06:13:43.579804 14894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:43.580147 14894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:43.581337 14894 hybrid_clock.cc:648] HybridClock initialized: now 1786515223581313 us; error 41 us; skew 500 ppm
Aug 12 06:13:43 dist-test-slave-gw5c krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515223, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:43.584456 14894 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:13:43.585047 14894 webserver.cc:460] Webserver started at http://127.0.176.194:42403/ using document root <none> and password file <none>
I20260812 06:13:43.585309 14894 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:43.585381 14894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:43.585541 14894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:43.586670 14894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "89096c5e66334c8fb6c9bc7d6ed3e45c"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "55424cd8efdb779680876abb928ed74e"
server_key_iv: "fb737b98538b6ad75503570080ea59c0"
server_key_version: "encryptionkey@0"
I20260812 06:13:43.587073 14894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "89096c5e66334c8fb6c9bc7d6ed3e45c"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "55424cd8efdb779680876abb928ed74e"
server_key_iv: "fb737b98538b6ad75503570080ea59c0"
server_key_version: "encryptionkey@0"
I20260812 06:13:43.588801 14894 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 06:13:43.589777 14923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:43.589996 14894 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:43.590119 14894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "89096c5e66334c8fb6c9bc7d6ed3e45c"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "55424cd8efdb779680876abb928ed74e"
server_key_iv: "fb737b98538b6ad75503570080ea59c0"
server_key_version: "encryptionkey@0"
I20260812 06:13:43.590210 14894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:43.602232 14894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:43.605147 14894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:43.605365 14894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:43.605662 14894 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:43.606024 14894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:43.606086 14894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:43.606127 14894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:43.606178 14894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:43.613113 14894 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:40535
I20260812 06:13:43.613170 15127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:40535 every 8 connection(s)
I20260812 06:13:43.613517 14894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:13:43.619323 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 14894
I20260812 06:13:43.619536 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:13:43.619750 707 external_mini_cluster.cc:1428] Setting key 7f6866f2c5f15dbcaaad4091b8a4fd64
Aug 12 06:13:43 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515223, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:43.624042 14612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:43.614334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:60247 (local address 127.0.176.254:35323)
0812 06:13:43.614409 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:43.614411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:43.614608 (+ 197us) server_negotiation.cc:407] Connection header received
0812 06:13:43.615593 (+ 985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:43.615594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:43.615605 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:43.615671 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:43.616294 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.616813 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.617812 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.617996 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.618050 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:43.620630 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:43.620631 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:43.620632 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:43.620640 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:43.622317 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:43.622884 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:43.622886 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:43.622886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:43.622946 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:43.623237 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:43.623238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:43.623238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:43.623346 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:43.623458 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:43.623803 (+ 345us) server_negotiation.cc:299] Negotiation successful
0812 06:13:43.623903 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 06:13:43.624224 15131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:43.614301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:60247)
0812 06:13:43.614472 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:43.614517 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:43.615498 (+ 981us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:43.615724 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:43.615727 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:43.616014 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:43.616218 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:43.616222 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.616915 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.616916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:43.617728 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:43.617730 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.618076 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.618077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:43.618180 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:43.618803 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:43.618812 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:43.620527 (+ 1715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:43.622428 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:43.622438 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:43.622442 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:43.622788 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:43.623017 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:43.623018 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:43.623018 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:43.623171 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:43.623451 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:43.623459 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:43.623647 (+ 188us) client_negotiation.cc:769] Sending connection context
0812 06:13:43.623762 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 06:13:43.623941 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260812 06:13:43.624917 15129 heartbeater.cc:347] Connected to a master server at 127.0.176.254:35323
I20260812 06:13:43.625051 15129 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:43.625250 15129 heartbeater.cc:511] Master 127.0.176.254:35323 requested a full tablet report, sending...
I20260812 06:13:43.625698 14536 ts_manager.cc:194] Registered new tserver with Master: 89096c5e66334c8fb6c9bc7d6ed3e45c (127.0.176.194:40535)
I20260812 06:13:43.626260 14536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:60247
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:13:43.648387 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:35323
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:43.733554 15136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:43.733892 15136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:43.733943 15136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:43.735168 15136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:43.735244 15136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:43.735347 15136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:43.737165 15136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:35323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:43.737427 15136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:43.737675 15136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:43.742653 15152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:43.742702 15144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:43.743000 15136 server_base.cc:1034] running on GCE node
W20260812 06:13:43.742682 15146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:43.743255 15136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:43.743569 15136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:43.744719 15136 hybrid_clock.cc:648] HybridClock initialized: now 1786515223744709 us; error 35 us; skew 500 ppm
Aug 12 06:13:43 dist-test-slave-gw5c krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515223, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:43.747268 15136 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:13:43.747751 15136 webserver.cc:460] Webserver started at http://127.0.176.195:40631/ using document root <none> and password file <none>
I20260812 06:13:43.747938 15136 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:43.747977 15136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:43.748070 15136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:43.749102 15136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "08f54b0a3bb54108a6ceb0f2c5b07c7b"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "4ede7c6e4834f56dc09907fe2ca1c7cb"
server_key_iv: "c5df2eba101374cce8c8f0e66377de38"
server_key_version: "encryptionkey@0"
I20260812 06:13:43.749420 15136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "08f54b0a3bb54108a6ceb0f2c5b07c7b"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "4ede7c6e4834f56dc09907fe2ca1c7cb"
server_key_iv: "c5df2eba101374cce8c8f0e66377de38"
server_key_version: "encryptionkey@0"
I20260812 06:13:43.750778 15136 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:13:43.751565 15163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:43.751787 15136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:13:43.751902 15136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "08f54b0a3bb54108a6ceb0f2c5b07c7b"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "4ede7c6e4834f56dc09907fe2ca1c7cb"
server_key_iv: "c5df2eba101374cce8c8f0e66377de38"
server_key_version: "encryptionkey@0"
I20260812 06:13:43.752000 15136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:43.771531 15136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:43.774052 15136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:43.774245 15136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:43.774528 15136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:43.774873 15136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:43.774930 15136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:43.774972 15136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:43.774998 15136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:43.781394 15136 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:40627
I20260812 06:13:43.781445 15380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:40627 every 8 connection(s)
I20260812 06:13:43.781795 15136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:13:43.784677 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 15136
I20260812 06:13:43.784802 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:13:43.784988 707 external_mini_cluster.cc:1428] Setting key 64f45644621edf47eab32dd4068bede1
Aug 12 06:13:43 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515223, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:13:43.792207 14612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:43.782568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:56339 (local address 127.0.176.254:35323)
0812 06:13:43.782640 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:43.782642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:43.782874 (+ 232us) server_negotiation.cc:407] Connection header received
0812 06:13:43.784061 (+ 1187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:43.784063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:43.784075 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:43.784154 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:43.785064 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.785763 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.786877 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.787088 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.787168 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:43.789530 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:43.789531 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:43.789532 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:43.789538 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:43.790962 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:43.791345 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:43.791345 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:43.791346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:43.791460 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:43.791669 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:43.791670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:43.791670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:43.791776 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:43.791827 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:43.792076 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 06:13:43.792140 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 06:13:43.792376 15386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:43.782554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:56339)
0812 06:13:43.782731 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:43.782777 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:43.783856 (+ 1079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:43.784213 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:43.784216 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:43.784576 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:43.784895 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:43.784901 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.785864 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.785865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:43.786775 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:43.786777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:43.787177 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:43.787178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:43.787314 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:43.787979 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:43.787987 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:43.789424 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:43.791042 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:43.791048 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:43.791050 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:43.791278 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:43.791508 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:13:43.791508 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:13:43.791508 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:13:43.791612 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:13:43.791832 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:43.791836 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:43.791957 (+ 121us) client_negotiation.cc:769] Sending connection context
0812 06:13:43.792042 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 06:13:43.792168 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":99,"threads_started":1}
I20260812 06:13:43.792936 15381 heartbeater.cc:347] Connected to a master server at 127.0.176.254:35323
I20260812 06:13:43.793051 15381 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:43.793251 15381 heartbeater.cc:511] Master 127.0.176.254:35323 requested a full tablet report, sending...
I20260812 06:13:43.793687 14536 ts_manager.cc:194] Registered new tserver with Master: 08f54b0a3bb54108a6ceb0f2c5b07c7b (127.0.176.195:40627)
I20260812 06:13:43.794138 14536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:56339
I20260812 06:13:43.796877 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab.
Entry for principal oryx/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab.
WARNING: no policy specified for oryx/127.0.176.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab.
Entry for principal oryx/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab.
WARNING: no policy specified for oryx/127.0.176.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab.
Entry for principal oryx/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab.
I20260812 06:13:43.876010 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 14654
I20260812 06:13:43.887351 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 14894
I20260812 06:13:43.914824 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 15136
I20260812 06:13:43.937855 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 14459
I20260812 06:13:43.962411 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:35323
--webserver_interface=127.0.176.254
--webserver_port=41565
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:35323
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:13:44.053480 15401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:44.053779 15401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:44.053823 15401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:44.055291 15401 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:44.055406 15401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:44.055485 15401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:44.055514 15401 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:44.055541 15401 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:44.057816 15401 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:35323
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:35323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=41565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:44.058184 15401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:44.058455 15401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:44.063618 15419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:44.063622 15410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:44.063644 15415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:44.063640 15401 server_base.cc:1034] running on GCE node
I20260812 06:13:44.064086 15401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:44.064368 15401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:44.065552 15401 hybrid_clock.cc:648] HybridClock initialized: now 1786515224065544 us; error 34 us; skew 500 ppm
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515224, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:44.068298 15401 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:13:44.068846 15401 webserver.cc:460] Webserver started at http://127.0.176.254:41565/ using document root <none> and password file <none>
I20260812 06:13:44.069096 15401 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:44.069191 15401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:44.070634 15401 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:13:44.071357 15428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:44.071590 15401 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:44.071697 15401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "fa8939cac3e842ecad689d32f8fab127"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "39d4ab98e2295f0021d21efe6426bb01"
server_key_iv: "875d603e8ff883cf4fc74ab8c9460475"
server_key_version: "encryptionkey@0"
I20260812 06:13:44.072098 15401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:44.083892 15401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:44.086498 15401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:44.086684 15401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:44.091173 15401 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:35323
I20260812 06:13:44.091219 15528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:35323 every 8 connection(s)
I20260812 06:13:44.091809 15401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:44.093192 15531 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:13:44.093897 15531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127: Bootstrap starting.
I20260812 06:13:44.098806 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 15401
I20260812 06:13:44.099174 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:43035
--local_ip_for_outbound_sockets=127.0.176.193
--tserver_master_addrs=127.0.176.254:35323
--webserver_port=33273
--webserver_interface=127.0.176.193
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.0.176.193
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:13:44.102793 15531 log.cc:824] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:44.104668 15531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:13:44.105001 15531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127: Bootstrap complete.
I20260812 06:13:44.107530 15531 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa8939cac3e842ecad689d32f8fab127" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35323 } }
I20260812 06:13:44.107821 15531 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8939cac3e842ecad689d32f8fab127, State: Initialized, Role: FOLLOWER
I20260812 06:13:44.108043 15531 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa8939cac3e842ecad689d32f8fab127" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35323 } }
I20260812 06:13:44.108147 15531 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:44.108204 15531 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:44.108255 15531 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:13:44.109380 15531 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa8939cac3e842ecad689d32f8fab127" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35323 } }
I20260812 06:13:44.109519 15531 leader_election.cc:302] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa8939cac3e842ecad689d32f8fab127; no voters:
I20260812 06:13:44.109747 15531 leader_election.cc:288] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 06:13:44.109791 15540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:13:44.109927 15540 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [term 2 LEADER]: Becoming Leader. State: Replica: fa8939cac3e842ecad689d32f8fab127, State: Running, Role: LEADER
I20260812 06:13:44.110095 15531 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:44.110105 15540 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa8939cac3e842ecad689d32f8fab127" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35323 } }
I20260812 06:13:44.110525 15541 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fa8939cac3e842ecad689d32f8fab127" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa8939cac3e842ecad689d32f8fab127" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35323 } } }
I20260812 06:13:44.110606 15541 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:44.110549 15543 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa8939cac3e842ecad689d32f8fab127. Latest consensus state: current_term: 2 leader_uuid: "fa8939cac3e842ecad689d32f8fab127" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa8939cac3e842ecad689d32f8fab127" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35323 } } }
I20260812 06:13:44.110661 15543 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:44.111135 15546 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:44.111749 15546 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:44.112128 15546 catalog_manager.cc:1259] Loaded cluster ID: a645fafa423b4d9ba4706ce5158f8807
I20260812 06:13:44.112174 15546 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:44.113430 15546 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:44.113690 15546 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fa8939cac3e842ecad689d32f8fab127: Loaded TSK: 0
I20260812 06:13:44.113921 15546 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:13:44.191210 15534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:44.191515 15534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:44.191547 15534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:44.192780 15534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:44.192830 15534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:44.192858 15534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:44.194422 15534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/oryx_127.0.176.193.keytab
--principal=oryx/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:43035
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=33273
--tserver_master_addrs=127.0.176.254:35323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:44.194710 15534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:44.194986 15534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:44.201480 15583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:44.201483 15581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:44.201818 15580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:44.201829 15534 server_base.cc:1034] running on GCE node
I20260812 06:13:44.202091 15534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:44.202397 15534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:44.203572 15534 hybrid_clock.cc:648] HybridClock initialized: now 1786515224203554 us; error 36 us; skew 500 ppm
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515224, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:44.206827 15534 init.cc:377] Logged in from keytab as oryx/127.0.176.193@KRBTEST.COM (short username oryx)
I20260812 06:13:44.207362 15534 webserver.cc:460] Webserver started at http://127.0.176.193:33273/ using document root <none> and password file <none>
I20260812 06:13:44.207665 15534 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:44.207772 15534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:44.209334 15534 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:44.210137 15601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:44.210510 15534 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:44.210618 15534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "ec9db77f66de422c980cf6964e5a16fb"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "1386ab61b2f202cd6ee5a067333ea00e"
server_key_iv: "27498f5bb8ce0906ffe9bc0ee27365e9"
server_key_version: "encryptionkey@0"
I20260812 06:13:44.211066 15534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:44.223631 15534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:44.226046 15534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:44.226222 15534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:44.226497 15534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:44.226836 15534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:44.226898 15534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:44.226943 15534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:44.226969 15534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:44.233901 15534 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:43035
I20260812 06:13:44.233965 15807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:43035 every 8 connection(s)
I20260812 06:13:44.234380 15534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:44.235754 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 15534
I20260812 06:13:44.236066 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:40535
--local_ip_for_outbound_sockets=127.0.176.194
--tserver_master_addrs=127.0.176.254:35323
--webserver_port=42403
--webserver_interface=127.0.176.194
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.0.176.194
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:44.249164 15812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:44.235291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:39965)
0812 06:13:44.235524 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:44.235589 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:44.236337 (+ 748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:44.240059 (+ 3722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:44.240064 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:44.240984 (+ 920us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:44.241305 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.241314 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.243206 (+ 1892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.243208 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.244486 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.244490 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.245425 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.245426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.245561 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.246249 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:44.246260 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:44.248999 (+ 2739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":119,"threads_started":1}
W20260812 06:13:44.249372 15813 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:44.235423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:39965 (local address 127.0.176.254:35323)
0812 06:13:44.239549 (+ 4126us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:44.239558 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:44.239613 (+ 55us) server_negotiation.cc:407] Connection header received
0812 06:13:44.239751 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:44.239758 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:44.239817 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:44.239968 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:44.241512 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.243075 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.244590 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.245296 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.245428 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.249194 (+ 3766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:39965: BlockingRecv error: recv got EOF from 127.0.176.193:39965 (error 108)
Metrics: {"server-negotiator.queue_time_us":4062,"thread_start_us":115,"threads_started":1}
W20260812 06:13:44.249462 15808 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:35323 (0 consecutive failures): Not authorized: Failed to ping master at 127.0.176.254:35323: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:44.254809 15812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:44.249690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:52135)
0812 06:13:44.249857 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:44.249880 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:44.249938 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:44.250064 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:44.250065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:44.250185 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:44.250233 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.250234 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.251171 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.251172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.251752 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.251754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.252219 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.252219 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.252266 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.252738 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:44.252742 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:44.254688 (+ 1946us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":122,"threads_started":1}
W20260812 06:13:44.254832 15813 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:44.249774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:52135 (local address 127.0.176.254:35323)
0812 06:13:44.249836 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:44.249838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:44.249937 (+ 99us) server_negotiation.cc:407] Connection header received
0812 06:13:44.249998 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:44.249999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:44.250012 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:44.250064 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:44.250294 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.251073 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.251833 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.252145 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.252216 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.254785 (+ 2569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:52135: BlockingRecv error: recv got EOF from 127.0.176.193:52135 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:44.259806 15812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:44.255130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:48285)
0812 06:13:44.255174 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:44.255183 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:44.255217 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:44.255372 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:44.255373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:44.255567 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:44.255604 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.255606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.256204 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.256205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.257029 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.257031 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.257363 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.257364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.257422 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.257834 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:44.257839 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:44.259716 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 06:13:44.259858 15813 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:44.255203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:48285 (local address 127.0.176.254:35323)
0812 06:13:44.255255 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:44.255257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:44.255271 (+ 14us) server_negotiation.cc:407] Connection header received
0812 06:13:44.255292 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:44.255293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:44.255301 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:44.255349 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:44.255679 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.256132 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.257111 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.257286 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.257341 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.259793 (+ 2452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:48285: BlockingRecv error: recv got EOF from 127.0.176.193:48285 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260812 06:13:44.260174 15808 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:13:44.329434 15814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:44.329694 15814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:44.329722 15814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:44.331029 15814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:44.331086 15814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:44.331116 15814 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:13:44.332863 15814 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/oryx_127.0.176.194.keytab
--principal=oryx/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:40535
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=42403
--tserver_master_addrs=127.0.176.254:35323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:44.333159 15814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:44.333432 15814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:44.339131 15823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:44.339143 15829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:44.339131 15826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:44.339617 15814 server_base.cc:1034] running on GCE node
I20260812 06:13:44.339819 15814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:44.340054 15814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:44.341204 15814 hybrid_clock.cc:648] HybridClock initialized: now 1786515224341190 us; error 31 us; skew 500 ppm
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515224, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:44.343977 15814 init.cc:377] Logged in from keytab as oryx/127.0.176.194@KRBTEST.COM (short username oryx)
I20260812 06:13:44.344419 15814 webserver.cc:460] Webserver started at http://127.0.176.194:42403/ using document root <none> and password file <none>
I20260812 06:13:44.344635 15814 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:44.344697 15814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:44.346114 15814 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:44.346757 15844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:44.346966 15814 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:13:44.347078 15814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "89096c5e66334c8fb6c9bc7d6ed3e45c"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "55424cd8efdb779680876abb928ed74e"
server_key_iv: "fb737b98538b6ad75503570080ea59c0"
server_key_version: "encryptionkey@0"
I20260812 06:13:44.347538 15814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:44.366627 15814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:44.369309 15814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:44.369503 15814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:44.369769 15814 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:44.370102 15814 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:44.370158 15814 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:44.370206 15814 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:44.370231 15814 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:44.376880 15814 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:40535
I20260812 06:13:44.376940 16059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:40535 every 8 connection(s)
I20260812 06:13:44.377300 15814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:13:44.382813 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 15814
I20260812 06:13:44.383176 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:40627
--local_ip_for_outbound_sockets=127.0.176.195
--tserver_master_addrs=127.0.176.254:35323
--webserver_port=40631
--webserver_interface=127.0.176.195
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.0.176.195
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:13:44.386025 15813 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:44.378399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:45569 (local address 127.0.176.254:35323)
0812 06:13:44.378493 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:44.378495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:44.378723 (+ 228us) server_negotiation.cc:407] Connection header received
0812 06:13:44.379234 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:44.379234 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:44.379251 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:44.379332 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:44.380392 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.380924 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.382002 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.382270 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.382348 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.385974 (+ 3626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:45569: BlockingRecv error: recv got EOF from 127.0.176.194:45569 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 06:13:44.386104 16065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:44.378317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:45569)
0812 06:13:44.378519 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:44.378563 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:44.379098 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:44.379440 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:44.379443 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:44.380052 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:44.380263 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.380267 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.381037 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.381038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.381892 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.381895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.382368 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.382368 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.382483 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.383130 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:44.383139 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:44.385856 (+ 2717us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":102,"threads_started":1}
W20260812 06:13:44.386341 16061 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:35323 (0 consecutive failures): Not authorized: Failed to ping master at 127.0.176.254:35323: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:44.391136 16065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:44.386617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:51707)
0812 06:13:44.386666 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:44.386676 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:44.386717 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:44.386872 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:44.386873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:44.387016 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:44.387065 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.387067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.387791 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.387792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.388331 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.388333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.388702 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.388703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.388771 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.389315 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:44.389320 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:44.391043 (+ 1723us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 06:13:44.391196 15813 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:44.386667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:51707 (local address 127.0.176.254:35323)
0812 06:13:44.386715 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:44.386718 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:44.386727 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:44.386779 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:44.386780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:44.386789 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:44.386868 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:44.387155 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.387710 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.388429 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.388616 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.388701 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.391129 (+ 2428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:51707: BlockingRecv error: recv got EOF from 127.0.176.194:51707 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:44.395999 16065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:44.391584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:52375)
0812 06:13:44.391633 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:44.391645 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:44.391686 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:44.391851 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:44.391852 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:44.391981 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:44.392012 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.392013 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.392645 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.392646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.393140 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.393141 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.393495 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.393496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.393550 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.394101 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:44.394106 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:44.395906 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 06:13:44.396055 15813 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:44.391675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:52375 (local address 127.0.176.254:35323)
0812 06:13:44.391737 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:44.391739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:44.391747 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:13:44.391768 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:44.391769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:44.391785 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:44.391847 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:44.392093 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.392565 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.393221 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.393418 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.393497 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.395987 (+ 2490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:52375: BlockingRecv error: recv got EOF from 127.0.176.194:52375 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260812 06:13:44.396291 16061 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:13:44.471596 16067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:44.471848 16067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:44.471876 16067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:44.473147 16067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:44.473201 16067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:44.473232 16067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:13:44.474929 16067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/krb5kdc/oryx_127.0.176.195.keytab
--principal=oryx/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:40627
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=40631
--tserver_master_addrs=127.0.176.254:35323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:44.475220 16067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:44.475559 16067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:44.481137 16075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:44.481295 16067 server_base.cc:1034] running on GCE node
W20260812 06:13:44.481137 16084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:44.481130 16078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:44.481657 16067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:44.481962 16067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:44.483148 16067 hybrid_clock.cc:648] HybridClock initialized: now 1786515224483136 us; error 40 us; skew 500 ppm
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515224, etypes {rep=17 tkt=17 ses=17}, oryx/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:13:44.486137 16067 init.cc:377] Logged in from keytab as oryx/127.0.176.195@KRBTEST.COM (short username oryx)
I20260812 06:13:44.486708 16067 webserver.cc:460] Webserver started at http://127.0.176.195:40631/ using document root <none> and password file <none>
I20260812 06:13:44.486955 16067 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:44.487039 16067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:44.488716 16067 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:44.489413 16104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:44.489675 16067 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:44.489790 16067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "08f54b0a3bb54108a6ceb0f2c5b07c7b"
format_stamp: "Formatted at 2026-08-12 06:13:43 on dist-test-slave-gw5c"
server_key: "4ede7c6e4834f56dc09907fe2ca1c7cb"
server_key_iv: "c5df2eba101374cce8c8f0e66377de38"
server_key_version: "encryptionkey@0"
I20260812 06:13:44.490162 16067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:44.500241 16067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:44.502714 16067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:44.502843 16067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:44.503049 16067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:44.503468 16067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:44.503515 16067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:44.503540 16067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:44.503553 16067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:44.510180 16067 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:40627
I20260812 06:13:44.510267 16317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:40627 every 8 connection(s)
I20260812 06:13:44.510649 16067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:13:44.519505 15813 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:44.511467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:47597 (local address 127.0.176.254:35323)
0812 06:13:44.511521 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:44.511524 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:44.511871 (+ 347us) server_negotiation.cc:407] Connection header received
0812 06:13:44.512440 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:44.512442 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:44.512455 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:44.512515 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:44.513538 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.514067 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.515155 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.515618 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.515726 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.519380 (+ 3654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:47597: BlockingRecv error: recv got EOF from 127.0.176.195:47597 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:13:44.519512 16322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:44.511506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:47597)
0812 06:13:44.511709 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:44.511758 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:44.512327 (+ 569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:44.512595 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:44.512599 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:44.513214 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:44.513429 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.513433 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.514176 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.514178 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.515053 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.515055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.515740 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.515741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.515891 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.516473 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:44.516483 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:44.519239 (+ 2756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":77,"threads_started":1}
W20260812 06:13:44.519948 16319 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:35323 (0 consecutive failures): Not authorized: Failed to ping master at 127.0.176.254:35323: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
I20260812 06:13:44.520284 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 16067
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:44.526185 16322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:44.520267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:37983)
0812 06:13:44.520366 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:44.520379 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:44.520450 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:44.520719 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:44.520720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:44.520897 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:44.520977 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.520980 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.521925 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.521926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.522677 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.522680 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.523154 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.523154 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.523206 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.523840 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:44.523846 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:44.526104 (+ 2258us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":73}
W20260812 06:13:44.526259 15813 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:44.520542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:37983 (local address 127.0.176.254:35323)
0812 06:13:44.520582 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:44.520585 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:44.520595 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:44.520628 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:44.520629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:44.520637 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:44.520711 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:44.521099 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.521804 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.522769 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.523070 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.523149 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.526193 (+ 3044us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:37983: BlockingRecv error: recv got EOF from 127.0.176.195:37983 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:13:44.530354 16323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:44.520892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38716 (local address 127.0.176.254:35323)
0812 06:13:44.521033 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:44.521036 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:44.521164 (+ 128us) server_negotiation.cc:407] Connection header received
0812 06:13:44.521226 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:44.521227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:44.521239 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:44.521322 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:44.522494 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.523202 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.524313 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.524624 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.524707 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.526051 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:44.526059 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:44.526059 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:13:44.526076 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:44.528315 (+ 2239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:44.528807 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:44.528811 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:44.528811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:44.529053 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:13:44.529376 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:13:44.529377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:13:44.529377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:13:44.529777 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:44.529943 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:44.530120 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 06:13:44.530218 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":72,"threads_started":1}
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:44 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:44.531695 16322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:44.526547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:38049)
0812 06:13:44.526599 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:44.526610 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:44.526651 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:44.526804 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:44.526805 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:44.526952 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:44.526994 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.526996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.527799 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.527801 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.528547 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:44.528550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.529003 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.529004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:44.529061 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.529512 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:44.529518 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:44.531645 (+ 2127us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 06:13:44.531764 15813 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:44.526625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:38049 (local address 127.0.176.254:35323)
0812 06:13:44.526667 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:44.526669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:44.526677 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:13:44.526702 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:44.526703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:44.526713 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:44.526784 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:44.527082 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.527708 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.528649 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:44.528915 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:44.528969 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:44.531721 (+ 2752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:38049: BlockingRecv error: recv got EOF from 127.0.176.195:38049 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 06:13:44.531860 16319 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 06:13:45 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:45 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:45.265952 16325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:45.260704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:56425)
0812 06:13:45.260887 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:45.260908 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:45.260975 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:45.261167 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:45.261169 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:45.261375 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:45.261429 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:45.261431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:45.262181 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:45.262183 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:45.262760 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:45.262761 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:45.263152 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:45.263153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:45.263214 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:45.263819 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:45.263824 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:45.265841 (+ 2017us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":109,"threads_started":1}
W20260812 06:13:45.266039 16327 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:45.260838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:56425 (local address 127.0.176.254:35323)
0812 06:13:45.261000 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:45.261002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:45.261012 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:45.261040 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:45.261041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:45.261052 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:45.261140 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:45.261528 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:45.262080 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:45.262862 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:45.263069 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:45.263151 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:45.265961 (+ 2810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:56425: BlockingRecv error: recv got EOF from 127.0.176.193:56425 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":104,"threads_started":1}
Aug 12 06:13:45 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:45 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:45.402017 16331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:45.396776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:40441)
0812 06:13:45.397023 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:45.397043 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:45.397148 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:45.397352 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:45.397353 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:45.397549 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:45.397601 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:45.397604 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:45.398306 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:45.398308 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:45.398866 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:45.398868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:45.399256 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:45.399258 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:45.399334 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:45.399884 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:45.399889 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:45.401928 (+ 2039us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":106,"threads_started":1}
W20260812 06:13:45.402086 16327 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:45.396907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:40441 (local address 127.0.176.254:35323)
0812 06:13:45.397017 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:45.397020 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:45.397124 (+ 104us) server_negotiation.cc:407] Connection header received
0812 06:13:45.397230 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:45.397231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:45.397245 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:45.397346 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:45.397687 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:45.398205 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:45.398973 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:45.399174 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:45.399257 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:45.402036 (+ 2779us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:40441: BlockingRecv error: recv got EOF from 127.0.176.194:40441 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 12 06:13:45 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:45 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:45.537478 16332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:45.532407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:54031)
0812 06:13:45.532619 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:45.532633 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:45.532740 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:45.532897 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:45.532898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:45.533096 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:45.533167 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:45.533169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:45.533876 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:45.533878 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:45.534427 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:45.534429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:45.534803 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:45.534804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:45.534877 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:45.535451 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:45.535457 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:45.537367 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":120,"threads_started":1}
W20260812 06:13:45.537536 16327 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:45.532544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:54031 (local address 127.0.176.254:35323)
0812 06:13:45.532628 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:45.532631 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:45.532719 (+ 88us) server_negotiation.cc:407] Connection header received
0812 06:13:45.532825 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:45.532826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:45.532838 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:45.532894 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:45.533257 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:45.533773 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:45.534526 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:45.534726 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:45.534806 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:45.537468 (+ 2662us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:54031: BlockingRecv error: recv got EOF from 127.0.176.195:54031 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 06:13:46 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:46 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:46.271688 16335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:46.266542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:33729)
0812 06:13:46.266809 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:46.266822 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:46.266883 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:46.267045 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:46.267046 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:46.267240 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:46.267295 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:46.267297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:46.268044 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:46.268045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:46.268587 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:46.268589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:46.268953 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:46.268954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:46.268994 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:46.269568 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:46.269575 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:46.271625 (+ 2050us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":199,"threads_started":1}
W20260812 06:13:46.271893 16336 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:46.266763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:33729 (local address 127.0.176.254:35323)
0812 06:13:46.266907 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:46.266909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:46.266919 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:46.266954 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:46.266954 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:46.266965 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:46.267027 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:46.267371 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:46.267960 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:46.268691 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:46.268885 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:46.268944 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:46.271749 (+ 2805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:33729: BlockingRecv error: recv got EOF from 127.0.176.193:33729 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":81,"threads_started":1}
Aug 12 06:13:46 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:46 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:46.408162 16341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:46.402813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:43881)
0812 06:13:46.402982 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:46.402996 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:46.403088 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:46.403256 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:46.403257 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:46.403488 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:46.403539 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:46.403541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:46.404469 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:46.404470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:46.405036 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:46.405038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:46.405410 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:46.405411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:46.405458 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:46.405950 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:46.405955 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:46.408100 (+ 2145us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":111,"threads_started":1}
W20260812 06:13:46.408301 16336 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:46.402970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:43881 (local address 127.0.176.254:35323)
0812 06:13:46.403036 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:46.403039 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:46.403067 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:13:46.403154 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:46.403155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:46.403170 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:46.403250 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:46.403642 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:46.404336 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:46.405135 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:46.405332 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:46.405392 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:46.408214 (+ 2822us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:43881: BlockingRecv error: recv got EOF from 127.0.176.194:43881 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 12 06:13:46 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:46 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:46.542924 16343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:46.537964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:51197)
0812 06:13:46.538151 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:46.538162 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:46.538234 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:46.538405 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:46.538406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:46.538578 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:46.538630 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:46.538632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:46.539328 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:46.539329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:46.539951 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:46.539954 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:46.540289 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:46.540290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:46.540335 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:46.540857 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:46.540862 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:46.542857 (+ 1995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":126,"threads_started":1}
W20260812 06:13:46.543087 16336 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:46.538083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:51197 (local address 127.0.176.254:35323)
0812 06:13:46.538129 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:46.538131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:46.538216 (+ 85us) server_negotiation.cc:407] Connection header received
0812 06:13:46.538277 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:46.538277 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:46.538289 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:46.538340 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:46.538704 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:46.539221 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:46.540031 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:46.540219 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:46.540274 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:46.542985 (+ 2711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:51197: BlockingRecv error: recv got EOF from 127.0.176.195:51197 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 12 06:13:47 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:47 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:47.281514 16347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:47.272253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:45701)
0812 06:13:47.272444 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:47.272456 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:47.272523 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:47.272728 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:47.272729 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:47.272921 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:47.272974 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:47.272976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:47.273681 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:47.273682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:47.274237 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:47.274238 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:47.274816 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:47.274817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:47.274890 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:47.279324 (+ 4434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:47.279332 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:47.281448 (+ 2116us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":125,"threads_started":1}
W20260812 06:13:47.281764 16348 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:47.272379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:45701 (local address 127.0.176.254:35323)
0812 06:13:47.272550 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:47.272552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:47.272563 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:47.272607 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:47.272608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:47.272619 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:47.272684 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:47.273059 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:47.273581 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:47.274341 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:47.274682 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:47.274811 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:47.281673 (+ 6862us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:45701: BlockingRecv error: recv got EOF from 127.0.176.193:45701 (error 108)
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":115,"threads_started":1}
Aug 12 06:13:47 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:47 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:47.414268 16349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:47.408812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:37295)
0812 06:13:47.408982 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:47.408995 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:47.409076 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:47.409214 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:47.409215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:47.409391 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:47.409445 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:47.409446 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:47.410115 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:47.410116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:47.410859 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:47.410863 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:47.411508 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:47.411509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:47.411617 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:47.412116 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:47.412121 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:47.414163 (+ 2042us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":79,"threads_started":1}
W20260812 06:13:47.414331 16348 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:47.408922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:37295 (local address 127.0.176.254:35323)
0812 06:13:47.409000 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:47.409002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:47.409070 (+ 68us) server_negotiation.cc:407] Connection header received
0812 06:13:47.409128 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:47.409129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:47.409140 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:47.409196 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:47.409507 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:47.410017 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:47.410960 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:47.411264 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:47.411536 (+ 272us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:47.414262 (+ 2726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:37295: BlockingRecv error: recv got EOF from 127.0.176.194:37295 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 06:13:47 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:47 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:47.549621 16351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:47.543746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:45755)
0812 06:13:47.543954 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:47.543966 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:47.544047 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:47.544243 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:47.544244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:47.544442 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:47.544496 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:47.544498 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:47.545225 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:47.545226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:47.545769 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:47.545771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:47.546232 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:47.546233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:47.546309 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:47.546864 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:47.546869 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:47.549535 (+ 2666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":84,"threads_started":1}
W20260812 06:13:47.549830 16348 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:47.543880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:45755 (local address 127.0.176.254:35323)
0812 06:13:47.543971 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:47.543973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:47.544069 (+ 96us) server_negotiation.cc:407] Connection header received
0812 06:13:47.544102 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:47.544103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:47.544115 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:47.544173 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:47.544598 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:47.545112 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:47.545931 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:47.546132 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:47.546228 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:47.549747 (+ 3519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:45755: BlockingRecv error: recv got EOF from 127.0.176.195:45755 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 06:13:48 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:48 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:48.287775 16352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:48.282115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:57519)
0812 06:13:48.282284 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:48.282297 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:48.282377 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:48.282535 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:48.282536 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:48.282940 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:48.283051 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:48.283056 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:48.283896 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:48.283897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:48.284482 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:48.284484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:48.284939 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:48.284941 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:48.284996 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:48.285643 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:48.285649 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:48.287713 (+ 2064us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":87,"threads_started":1}
W20260812 06:13:48.287947 16353 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:48.282267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:57519 (local address 127.0.176.254:35323)
0812 06:13:48.282403 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:48.282405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:48.282415 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:48.282443 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:48.282444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:48.282454 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:48.282516 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:48.283214 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:48.283785 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:48.284581 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:48.284780 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:48.284943 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:48.287840 (+ 2897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:57519: BlockingRecv error: recv got EOF from 127.0.176.193:57519 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":79,"threads_started":1}
Aug 12 06:13:48 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:48 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:48.419988 16355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:48.414909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:43745)
0812 06:13:48.415051 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:48.415073 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:48.415148 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:48.415302 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:48.415303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:48.415550 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:48.415608 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:48.415611 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:48.416248 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:48.416249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:48.416773 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:48.416775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:48.417232 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:48.417233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:48.417303 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:48.417769 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:48.417774 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:48.419925 (+ 2151us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":68,"threads_started":1}
W20260812 06:13:48.420127 16353 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:48.415014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:43745 (local address 127.0.176.254:35323)
0812 06:13:48.415098 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:48.415100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:48.415142 (+ 42us) server_negotiation.cc:407] Connection header received
0812 06:13:48.415215 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:48.415215 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:48.415227 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:48.415279 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:48.415679 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:48.416175 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:48.416842 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:48.417147 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:48.417218 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:48.420041 (+ 2823us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:43745: BlockingRecv error: recv got EOF from 127.0.176.194:43745 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 06:13:48 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:48 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:48.555716 16356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:48.550203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:44427)
0812 06:13:48.550356 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:48.550368 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:48.550435 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:48.550556 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:48.550557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:48.550904 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:48.550995 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:48.551001 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:48.552189 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:48.552190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:48.552774 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:48.552776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:48.553147 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:48.553148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:48.553188 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:48.553694 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:48.553699 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:48.555647 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":101,"threads_started":1}
W20260812 06:13:48.555822 16353 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:48.550255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:44427 (local address 127.0.176.254:35323)
0812 06:13:48.550349 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:48.550352 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:48.550452 (+ 100us) server_negotiation.cc:407] Connection header received
0812 06:13:48.550478 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:48.550479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:48.550492 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:48.550544 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:48.551132 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:48.552065 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:48.552876 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:48.553073 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:48.553136 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:48.555749 (+ 2613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:44427: BlockingRecv error: recv got EOF from 127.0.176.195:44427 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 06:13:49 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:49 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:49.293656 16357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:49.288400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:54641)
0812 06:13:49.288556 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:49.288567 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:49.288642 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:49.288832 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:49.288832 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:49.289020 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:49.289075 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:49.289078 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:49.289779 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:49.289780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:49.290326 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:49.290327 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:49.290680 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:49.290681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:49.290724 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:49.291272 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:49.291277 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:49.293550 (+ 2273us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":92,"threads_started":1}
W20260812 06:13:49.293890 16359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:49.288503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:54641 (local address 127.0.176.254:35323)
0812 06:13:49.288687 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:49.288689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:49.288700 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:49.288728 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:49.288729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:49.288738 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:49.288815 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:49.289151 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:49.289683 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:49.290412 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:49.290608 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:49.290662 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:49.293733 (+ 3071us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:54641: BlockingRecv error: recv got EOF from 127.0.176.193:54641 (error 108)
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":89,"threads_started":1}
Aug 12 06:13:49 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:49 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:49.425504 16360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:49.420639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:38623)
0812 06:13:49.420856 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:49.420870 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:49.420959 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:49.421110 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:49.421111 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:49.421288 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:49.421342 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:49.421344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:49.422002 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:49.422003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:49.422537 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:49.422538 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:49.422881 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:49.422882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:49.422923 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:49.423466 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:49.423478 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:49.425407 (+ 1929us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":103,"threads_started":1}
W20260812 06:13:49.425702 16359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:49.420824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:38623 (local address 127.0.176.254:35323)
0812 06:13:49.420904 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:49.420905 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:49.420934 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:13:49.421022 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:49.421022 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:49.421033 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:49.421082 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:49.421413 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:49.421917 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:49.422629 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:49.422813 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:49.422866 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:49.425544 (+ 2678us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:38623: BlockingRecv error: recv got EOF from 127.0.176.194:38623 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 06:13:49 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:49 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:49.561545 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:49.556359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:33781)
0812 06:13:49.556709 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:49.556722 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:49.556795 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:49.556963 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:49.556965 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:49.557159 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:49.557209 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:49.557211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:49.558034 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:49.558035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:49.558566 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:49.558568 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:49.558980 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:49.558981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:49.559047 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:49.559596 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:49.559600 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:49.561452 (+ 1852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":111,"threads_started":1}
W20260812 06:13:49.561623 16359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:49.556511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:33781 (local address 127.0.176.254:35323)
0812 06:13:49.556607 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:49.556609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:49.556796 (+ 187us) server_negotiation.cc:407] Connection header received
0812 06:13:49.556845 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:49.556846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:49.556865 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:49.556951 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:49.557300 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:49.557948 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:49.558662 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:49.558872 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:49.558953 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:49.561557 (+ 2604us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:33781: BlockingRecv error: recv got EOF from 127.0.176.195:33781 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 06:13:50 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:50 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:50.299177 16362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:50.294277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:46905)
0812 06:13:50.294443 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:50.294461 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:50.294523 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:50.294655 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:50.294655 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:50.294844 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:50.294895 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:50.294896 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:50.295790 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:50.295792 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:50.296353 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:50.296355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:50.296715 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:50.296717 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:50.296771 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:50.297249 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:50.297266 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:50.299116 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":93,"threads_started":1}
W20260812 06:13:50.299328 16364 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:50.294399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:46905 (local address 127.0.176.254:35323)
0812 06:13:50.294524 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:50.294526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:50.294555 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:13:50.294577 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:50.294577 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:50.294587 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:50.294638 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:50.295001 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:50.295531 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:50.296436 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:50.296624 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:50.296674 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:50.299233 (+ 2559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:46905: BlockingRecv error: recv got EOF from 127.0.176.193:46905 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":62,"threads_started":1}
Aug 12 06:13:50 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:50 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:50.432718 16366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:50.426058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:57445)
0812 06:13:50.426342 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:50.426353 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:50.426408 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:50.426690 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:50.426693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:50.426952 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:50.427121 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:50.427128 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:50.428291 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:50.428292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:50.429008 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:50.429011 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:50.429754 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:50.429755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:50.429809 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:50.430381 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:50.430386 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:50.432656 (+ 2270us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":211,"threads_started":1}
W20260812 06:13:50.432957 16364 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:50.426238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:57445 (local address 127.0.176.254:35323)
0812 06:13:50.426308 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:50.426310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:50.426411 (+ 101us) server_negotiation.cc:407] Connection header received
0812 06:13:50.426473 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:50.426475 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:50.426492 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:50.426566 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:50.427250 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:50.428180 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:50.429122 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:50.429502 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:50.429586 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:50.432819 (+ 3233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:57445: BlockingRecv error: recv got EOF from 127.0.176.194:57445 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 06:13:50 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:50 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:50.567793 16367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:50.562218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:51041)
0812 06:13:50.562472 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:50.562485 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:50.562667 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:50.562904 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:50.562906 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:50.563105 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:50.563156 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:50.563158 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:50.564088 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:50.564089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:50.564646 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:50.564648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:50.565035 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:50.565036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:50.565097 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:50.565616 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:50.565621 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:50.567686 (+ 2065us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":139,"threads_started":1}
W20260812 06:13:50.567850 16364 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:50.562349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:51041 (local address 127.0.176.254:35323)
0812 06:13:50.562462 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:50.562464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:50.562570 (+ 106us) server_negotiation.cc:407] Connection header received
0812 06:13:50.562803 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:50.562804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:50.562820 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:50.562894 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:50.563250 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:50.563958 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:50.564739 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:50.564956 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:50.565038 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:50.567784 (+ 2746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:51041: BlockingRecv error: recv got EOF from 127.0.176.195:51041 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 12 06:13:51 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:51 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:51.304697 16368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:51.299747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:34361)
0812 06:13:51.299917 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:51.299936 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:51.299991 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:51.300199 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:51.300200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:51.300450 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:51.300501 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:51.300503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:51.301381 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:51.301382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:51.301933 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:51.301935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:51.302275 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:51.302275 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:51.302322 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:51.302794 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:51.302799 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:51.304636 (+ 1837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":105,"threads_started":1}
W20260812 06:13:51.304909 16370 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:51.299867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:34361 (local address 127.0.176.254:35323)
0812 06:13:51.300026 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:51.300028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:51.300037 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:51.300063 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:51.300064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:51.300076 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:51.300184 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:51.300564 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:51.301278 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:51.302016 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:51.302206 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:51.302274 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:51.304820 (+ 2546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:34361: BlockingRecv error: recv got EOF from 127.0.176.193:34361 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":99,"threads_started":1}
Aug 12 06:13:51 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:51 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:51.438374 16371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:51.433400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:45811)
0812 06:13:51.433605 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:51.433617 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:51.433707 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:51.433874 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:51.433876 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:51.434072 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:51.434131 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:51.434133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:51.434795 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:51.434796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:51.435352 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:51.435354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:51.435812 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:51.435813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:51.435861 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:51.436427 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:51.436433 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:51.438313 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":98,"threads_started":1}
W20260812 06:13:51.438591 16370 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:51.433495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:45811 (local address 127.0.176.254:35323)
0812 06:13:51.433575 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:51.433584 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:51.433688 (+ 104us) server_negotiation.cc:407] Connection header received
0812 06:13:51.433783 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:51.433784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:51.433798 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:51.433857 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:51.434206 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:51.434710 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:51.435533 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:51.435740 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:51.435796 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:51.438480 (+ 2684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:45811: BlockingRecv error: recv got EOF from 127.0.176.194:45811 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 12 06:13:51 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:51 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:51.574647 16372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:51.568416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:38357)
0812 06:13:51.568571 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:51.568587 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:51.568649 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:51.568951 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:51.568952 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:51.569127 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:51.569184 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:51.569186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:51.570110 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:51.570111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:51.570647 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:51.570648 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:51.571041 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:51.571042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:51.571109 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:51.571773 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:51.571778 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:51.574495 (+ 2717us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":96,"threads_started":1}
W20260812 06:13:51.574692 16370 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:51.568508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:38357 (local address 127.0.176.254:35323)
0812 06:13:51.568742 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:51.568746 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:51.568767 (+ 21us) server_negotiation.cc:407] Connection header received
0812 06:13:51.568803 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:51.568804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:51.568825 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:51.568929 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:51.569326 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:51.569991 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:51.570744 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:51.570944 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:51.571011 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:51.574620 (+ 3609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:38357: BlockingRecv error: recv got EOF from 127.0.176.195:38357 (error 108)
Metrics: {"server-negotiator.queue_time_us":179}
Aug 12 06:13:52 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:52 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:52.313997 16375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:52.305329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:55969)
0812 06:13:52.305576 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:52.305606 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:52.305717 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:52.306099 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:52.306101 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:52.306307 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:52.306369 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:52.306371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:52.307184 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:52.307185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:52.307815 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:52.307817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:52.308218 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:52.308219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:52.308259 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:52.311453 (+ 3194us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:52.311459 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:52.313920 (+ 2461us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":74,"threads_started":1}
W20260812 06:13:52.314126 16376 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:52.305734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:55969 (local address 127.0.176.254:35323)
0812 06:13:52.305889 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:52.305891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:52.305898 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:13:52.305929 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:52.305929 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:52.305942 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:52.306009 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:52.306525 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:52.307087 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:52.307918 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:52.308126 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:52.308217 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:52.314039 (+ 5822us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:55969: BlockingRecv error: recv got EOF from 127.0.176.193:55969 (error 108)
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":73,"threads_started":1}
Aug 12 06:13:52 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:52 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:52.444226 16379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:52.439028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:52437)
0812 06:13:52.439208 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:52.439219 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:52.439312 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:52.439522 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:52.439524 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:52.439733 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:52.439784 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:52.439786 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:52.440633 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:52.440634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:52.441167 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:52.441169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:52.441543 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:52.441544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:52.441614 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:52.442138 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:52.442142 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:52.444128 (+ 1986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":82,"threads_started":1}
W20260812 06:13:52.444296 16376 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:52.439116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:52437 (local address 127.0.176.254:35323)
0812 06:13:52.439175 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:52.439177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:52.439290 (+ 113us) server_negotiation.cc:407] Connection header received
0812 06:13:52.439424 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:52.439426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:52.439439 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:52.439514 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:52.439877 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:52.440539 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:52.441259 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:52.441462 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:52.441542 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:52.444231 (+ 2689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:52437: BlockingRecv error: recv got EOF from 127.0.176.194:52437 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 12 06:13:52 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:52 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:52.580147 16380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:52.575287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:54079)
0812 06:13:52.575472 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:52.575485 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:52.575595 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:52.575784 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:52.575785 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:52.575999 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:52.576053 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:52.576055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:52.576757 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:52.576758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:52.577290 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:52.577292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:52.577652 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:52.577653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:52.577712 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:52.578209 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:52.578213 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:52.580087 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":123,"threads_started":1}
W20260812 06:13:52.580312 16376 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:52.575370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:54079 (local address 127.0.176.254:35323)
0812 06:13:52.575478 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:52.575480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:52.575566 (+ 86us) server_negotiation.cc:407] Connection header received
0812 06:13:52.575677 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:52.575678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:52.575694 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:52.575769 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:52.576147 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:52.576670 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:52.577383 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:52.577573 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:52.577654 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:52.580225 (+ 2571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:54079: BlockingRecv error: recv got EOF from 127.0.176.195:54079 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 12 06:13:53 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:53 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:53.319818 16382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:53.314686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:47523)
0812 06:13:53.314910 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:53.314927 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:53.315009 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:53.315177 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:53.315178 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:53.315371 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:53.315490 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:53.315493 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:53.316195 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:53.316195 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:53.316717 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:53.316718 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:53.317112 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:53.317113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:53.317152 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:53.317667 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:53.317671 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:53.319744 (+ 2073us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":112,"threads_started":1}
W20260812 06:13:53.320009 16388 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:53.314802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:47523 (local address 127.0.176.254:35323)
0812 06:13:53.315009 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:53.315011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:53.315051 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:13:53.315078 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:53.315079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:53.315094 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:53.315150 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:53.315595 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:53.316121 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:53.316823 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:53.317035 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:53.317103 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:53.319890 (+ 2787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:47523: BlockingRecv error: recv got EOF from 127.0.176.193:47523 (error 108)
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":83,"threads_started":1}
Aug 12 06:13:53 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:53 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:53.450896 16389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:53.444957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:45935)
0812 06:13:53.445179 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:53.445199 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:53.445274 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:53.445442 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:53.445443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:53.445661 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:53.445727 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:53.445729 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:53.446490 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:53.446491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:53.447135 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:53.447138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:53.447715 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:53.447716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:53.447785 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:53.448488 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:53.448493 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:53.450821 (+ 2328us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":154,"threads_started":1}
W20260812 06:13:53.451081 16388 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:53.445081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:45935 (local address 127.0.176.254:35323)
0812 06:13:53.445169 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:53.445171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:53.445271 (+ 100us) server_negotiation.cc:407] Connection header received
0812 06:13:53.445328 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:53.445329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:53.445341 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:53.445412 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:53.445861 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:53.446380 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:53.447274 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:53.447532 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:53.447674 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:53.450978 (+ 3304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:45935: BlockingRecv error: recv got EOF from 127.0.176.194:45935 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 06:13:53 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:53 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:53.585927 16391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:53.580722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:54571)
0812 06:13:53.580885 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:53.580912 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:53.581007 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:53.581265 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:53.581266 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:53.581486 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:53.581554 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:53.581556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:53.582289 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:53.582290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:53.582832 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:53.582834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:53.583194 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:53.583195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:53.583255 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:53.583794 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:53.583799 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:53.585810 (+ 2011us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":105,"threads_started":1}
W20260812 06:13:53.585991 16388 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:53.580871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:54571 (local address 127.0.176.254:35323)
0812 06:13:53.580945 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:53.580947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:53.580999 (+ 52us) server_negotiation.cc:407] Connection header received
0812 06:13:53.581107 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:53.581107 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:53.581122 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:53.581188 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:53.581641 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:53.582192 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:53.582923 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:53.583114 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:53.583196 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:53.585922 (+ 2726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:54571: BlockingRecv error: recv got EOF from 127.0.176.195:54571 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 12 06:13:54 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:54 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:54.326936 16392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:54.320399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:52717)
0812 06:13:54.320552 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:54.320571 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:54.320633 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:54.320888 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:54.320889 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:54.321067 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:54.321120 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:54.321122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:54.321901 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:54.321902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:54.322593 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:54.322596 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:54.322977 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:54.322978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:54.323041 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:54.323826 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:54.323832 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:54.326802 (+ 2970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":92,"threads_started":1}
W20260812 06:13:54.326982 16394 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:54.320551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:52717 (local address 127.0.176.254:35323)
0812 06:13:54.320732 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:54.320734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:54.320743 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:54.320772 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:54.320772 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:54.320784 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:54.320866 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:54.321194 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:54.321795 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:54.322683 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:54.322897 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:54.322978 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:54.326903 (+ 3925us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:52717: BlockingRecv error: recv got EOF from 127.0.176.193:52717 (error 108)
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":119,"threads_started":1}
Aug 12 06:13:54 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:54 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:54.456933 16402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:54.451528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:51535)
0812 06:13:54.451765 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:54.451780 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:54.451885 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:54.452074 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:54.452075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:54.452277 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:54.452339 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:54.452341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:54.453041 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:54.453043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:54.453576 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:54.453578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:54.453960 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:54.453962 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:54.454020 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:54.454535 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:54.454540 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:54.456830 (+ 2290us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":109,"threads_started":1}
W20260812 06:13:54.456998 16394 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:54.451658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:51535 (local address 127.0.176.254:35323)
0812 06:13:54.451771 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:54.451773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:54.451864 (+ 91us) server_negotiation.cc:407] Connection header received
0812 06:13:54.451973 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:54.451974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:54.451988 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:54.452067 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:54.452426 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:54.452955 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:54.453671 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:54.453878 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:54.453962 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:54.456931 (+ 2969us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:51535: BlockingRecv error: recv got EOF from 127.0.176.194:51535 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 12 06:13:54 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:54 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:54.591514 16404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:54.586598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:42883)
0812 06:13:54.586811 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:54.586827 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:54.586913 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:54.587062 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:54.587062 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:54.587258 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:54.587314 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:54.587316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:54.588018 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:54.588019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:54.588568 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:54.588570 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:54.588920 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:54.588921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:54.589000 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:54.589602 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:54.589608 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:54.591410 (+ 1802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":87,"threads_started":1}
W20260812 06:13:54.591559 16394 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:54.586806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:42883 (local address 127.0.176.254:35323)
0812 06:13:54.586889 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:54.586891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:54.586900 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:54.586969 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:54.586970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:54.586982 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:54.587032 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:54.587412 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:54.587917 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:54.588650 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:54.588827 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:54.588885 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:54.591494 (+ 2609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:42883: BlockingRecv error: recv got EOF from 127.0.176.195:42883 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 06:13:55 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:55 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:55.332787 16407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:55.327630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:41195)
0812 06:13:55.327791 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:55.327802 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:55.327856 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:55.328095 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:55.328096 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:55.328280 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:55.328331 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:55.328332 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:55.329051 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:55.329052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:55.329652 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:55.329654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:55.330150 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:55.330151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:55.330217 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:55.330708 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:55.330713 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:55.332669 (+ 1956us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":94,"threads_started":1}
W20260812 06:13:55.332841 16408 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:55.327768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:41195 (local address 127.0.176.254:35323)
0812 06:13:55.327929 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:55.327931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:55.327941 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:55.327969 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:55.327970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:55.327981 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:55.328081 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:55.328429 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:55.328966 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:55.329732 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:55.330060 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:55.330132 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:55.332763 (+ 2631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:41195: BlockingRecv error: recv got EOF from 127.0.176.193:41195 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
Aug 12 06:13:55 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:55 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:55.462940 16412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:55.457527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:46675)
0812 06:13:55.457709 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:55.457721 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:55.457782 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:55.457942 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:55.457942 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:55.458117 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:55.458171 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:55.458173 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:55.458843 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:55.458844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:55.459513 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:55.459516 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:55.459868 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:55.459869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:55.459920 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:55.460453 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:55.460458 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:55.462861 (+ 2403us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":116,"threads_started":1}
W20260812 06:13:55.463061 16408 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:55.457640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:46675 (local address 127.0.176.254:35323)
0812 06:13:55.457692 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:55.457694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:55.457772 (+ 78us) server_negotiation.cc:407] Connection header received
0812 06:13:55.457852 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:55.457852 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:55.457863 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:55.457910 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:55.458243 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:55.458754 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:55.459591 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:55.459774 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:55.459823 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:55.462959 (+ 3136us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:46675: BlockingRecv error: recv got EOF from 127.0.176.194:46675 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 12 06:13:55 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:55 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:55.598417 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:55.592238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:40179)
0812 06:13:55.592423 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:55.592439 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:55.592847 (+ 408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:55.593065 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:55.593066 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:55.593256 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:55.593306 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:55.593308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:55.594350 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:55.594351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:55.595105 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:55.595108 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:55.595722 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:55.595723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:55.595788 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:55.596346 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:55.596350 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:55.598305 (+ 1955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":131,"threads_started":1}
W20260812 06:13:55.598483 16408 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:55.592479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:40179 (local address 127.0.176.254:35323)
0812 06:13:55.592542 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:55.592546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:55.592896 (+ 350us) server_negotiation.cc:407] Connection header received
0812 06:13:55.592939 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:55.592940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:55.592959 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:55.593025 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:55.593474 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:55.594157 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:55.595229 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:55.595640 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:55.595712 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:55.598407 (+ 2695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:40179: BlockingRecv error: recv got EOF from 127.0.176.195:40179 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 12 06:13:56 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:56 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:56.338584 16416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:56.333531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:57155)
0812 06:13:56.333734 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:56.333744 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:56.333798 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:56.333963 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:56.333963 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:56.334151 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:56.334202 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:56.334204 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:56.334896 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:56.334896 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:56.335552 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:56.335554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:56.336008 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:56.336009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:56.336062 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:56.336575 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:56.336588 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:56.338519 (+ 1931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":98,"threads_started":1}
W20260812 06:13:56.338804 16420 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:56.333652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:57155 (local address 127.0.176.254:35323)
0812 06:13:56.333816 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:56.333818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:56.333827 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:13:56.333853 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:56.333854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:56.333865 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:56.333940 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:56.334279 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:56.334807 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:56.335695 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:56.335904 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:56.335979 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:56.338717 (+ 2738us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:57155: BlockingRecv error: recv got EOF from 127.0.176.193:57155 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":97,"threads_started":1}
Aug 12 06:13:56 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:56 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:56.469574 16421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:56.463512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:48967)
0812 06:13:56.463760 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:56.463773 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:56.463859 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:56.464034 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:56.464035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:56.464239 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:56.464297 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:56.464298 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:56.465135 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:56.465136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:56.465689 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:56.465691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:56.466068 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:56.466069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:56.466130 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:56.466716 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:56.466721 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:56.469476 (+ 2755us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":100,"threads_started":1}
W20260812 06:13:56.469655 16420 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:56.463623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:48967 (local address 127.0.176.254:35323)
0812 06:13:56.463735 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:56.463737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:56.463854 (+ 117us) server_negotiation.cc:407] Connection header received
0812 06:13:56.463928 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:56.463929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:56.463943 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:56.464025 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:56.464394 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:56.465027 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:56.465780 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:56.465989 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:56.466069 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:56.469590 (+ 3521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:48967: BlockingRecv error: recv got EOF from 127.0.176.194:48967 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 12 06:13:56 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:56 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:56.604107 16422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:56.599015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:36271)
0812 06:13:56.599270 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:56.599283 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:56.599397 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:56.599588 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:56.599589 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:56.599807 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:56.599856 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:56.599858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:56.600551 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:56.600552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:56.601107 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:56.601109 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:56.601483 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:56.601484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:56.601544 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:56.602051 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:56.602056 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:56.603989 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":116,"threads_started":1}
W20260812 06:13:56.604152 16420 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:56.599143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:36271 (local address 127.0.176.254:35323)
0812 06:13:56.599245 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:56.599247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:56.599379 (+ 132us) server_negotiation.cc:407] Connection header received
0812 06:13:56.599487 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:56.599488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:56.599502 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:56.599588 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:56.599944 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:56.600457 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:56.601198 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:56.601391 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:56.601480 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:56.604083 (+ 2603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:36271: BlockingRecv error: recv got EOF from 127.0.176.195:36271 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 06:13:57 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:57 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:57.349404 16423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:57.339183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:39811)
0812 06:13:57.339357 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:57.339373 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:57.339486 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:57.339635 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:57.339636 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:57.339820 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:57.339868 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:57.339870 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:57.340603 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:57.340603 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:57.341143 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:57.341145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:57.341486 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:57.341487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:57.341528 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:57.346942 (+ 5414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:57.346949 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:57.349329 (+ 2380us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":110,"threads_started":1}
W20260812 06:13:57.349531 16424 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:57.339290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:39811 (local address 127.0.176.254:35323)
0812 06:13:57.339453 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:57.339455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:57.339493 (+ 38us) server_negotiation.cc:407] Connection header received
0812 06:13:57.339543 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:57.339544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:57.339557 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:57.339615 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:57.339962 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:57.340529 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:57.341220 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:57.341411 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:57.341463 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:57.349449 (+ 7986us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:39811: BlockingRecv error: recv got EOF from 127.0.176.193:39811 (error 108)
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":84,"threads_started":1}
Aug 12 06:13:57 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:57 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:57.476397 16426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:57.470358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:42633)
0812 06:13:57.470529 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:57.470542 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:57.470612 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:57.470811 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:57.470812 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:57.471043 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:57.471095 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:57.471097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:57.471783 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:57.471784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:57.472305 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:57.472307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:57.472995 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:57.472996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:57.473049 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:57.473734 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:57.473742 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:57.476291 (+ 2549us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":73,"threads_started":1}
W20260812 06:13:57.476454 16424 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:57.470575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:42633 (local address 127.0.176.254:35323)
0812 06:13:57.470643 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:57.470646 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:57.470656 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:13:57.470690 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:57.470690 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:57.470720 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:57.470790 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:57.471162 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:57.471699 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:57.472382 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:57.472891 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:57.472966 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:57.476387 (+ 3421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:42633: BlockingRecv error: recv got EOF from 127.0.176.194:42633 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 12 06:13:57 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:57 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:57.611335 16427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:57.604746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:47419)
0812 06:13:57.605002 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:57.605016 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:57.605113 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:57.605270 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:57.605271 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:57.605481 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:57.605534 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:57.605536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:57.606679 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:57.606682 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:57.607273 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:57.607275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:57.607750 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:57.607751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:57.607814 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:57.608524 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:57.608532 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:57.611228 (+ 2696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":137,"threads_started":1}
W20260812 06:13:57.611438 16424 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:57.604894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:47419 (local address 127.0.176.254:35323)
0812 06:13:57.604990 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:57.604993 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:57.605093 (+ 100us) server_negotiation.cc:407] Connection header received
0812 06:13:57.605172 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:57.605173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:57.605190 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:57.605264 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:57.605913 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:57.606557 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:57.607381 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:57.607631 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:57.607750 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:57.611345 (+ 3595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:47419: BlockingRecv error: recv got EOF from 127.0.176.195:47419 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 12 06:13:58 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:58 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:58.355780 16430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:58.350012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:52789)
0812 06:13:58.350235 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:58.350248 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:58.350331 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:58.350493 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:58.350494 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:58.350754 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:58.350811 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:58.350813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:58.351514 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:58.351515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:58.352060 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:58.352061 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:58.352413 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:58.352414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:58.352456 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:58.353124 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:58.353129 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:58.355715 (+ 2586us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":97,"threads_started":1}
W20260812 06:13:58.355998 16431 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:58.350149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:52789 (local address 127.0.176.254:35323)
0812 06:13:58.350287 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:58.350288 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:58.350304 (+ 16us) server_negotiation.cc:407] Connection header received
0812 06:13:58.350407 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:58.350407 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:58.350418 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:58.350486 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:58.350891 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:58.351445 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:58.352145 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:58.352336 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:58.352393 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:58.355899 (+ 3506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:52789: BlockingRecv error: recv got EOF from 127.0.176.193:52789 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":80,"threads_started":1}
Aug 12 06:13:58 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:58 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:58.481634 16434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:58.476907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:40749)
0812 06:13:58.477085 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:58.477096 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:58.477181 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:58.477316 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:58.477317 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:58.477514 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:58.477562 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:58.477564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:58.478246 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:58.478247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:58.478794 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:58.478796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:58.479179 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:58.479180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:58.479241 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:58.479758 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:58.479763 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:58.481522 (+ 1759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":110,"threads_started":1}
W20260812 06:13:58.481676 16431 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:58.476996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:40749 (local address 127.0.176.254:35323)
0812 06:13:58.477068 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:58.477070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:58.477169 (+ 99us) server_negotiation.cc:407] Connection header received
0812 06:13:58.477242 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:58.477243 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:58.477256 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:58.477307 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:58.477647 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:58.478158 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:58.478887 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:58.479100 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:58.479181 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:58.481610 (+ 2429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:40749: BlockingRecv error: recv got EOF from 127.0.176.194:40749 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 12 06:13:58 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:58 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.195@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:58.617183 16437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:58.611970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.195:43283)
0812 06:13:58.612142 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:58.612160 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:58.612221 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:58.612360 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:58.612361 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:58.612554 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:58.612626 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:58.612629 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:58.613354 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:58.613355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:58.613916 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:58.613918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:58.614259 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:58.614260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:58.614322 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:58.614850 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:58.614854 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:58.617078 (+ 2224us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":113,"threads_started":1}
W20260812 06:13:58.617242 16431 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:58.612084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:43283 (local address 127.0.176.254:35323)
0812 06:13:58.612147 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:58.612149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:58.612223 (+ 74us) server_negotiation.cc:407] Connection header received
0812 06:13:58.612267 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:58.612268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:58.612281 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:58.612341 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:58.612704 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:58.613213 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:58.614004 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:58.614185 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:58.614243 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:58.617177 (+ 2934us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.195:43283: BlockingRecv error: recv got EOF from 127.0.176.195:43283 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 06:13:59 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:59 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.193@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:59.361286 16438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:59.356408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.193:60205)
0812 06:13:59.356594 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:59.356614 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:59.356675 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:59.356811 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:59.356811 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:59.356982 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:59.357034 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:59.357035 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.357763 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.357764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:59.358280 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:59.358282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.358621 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.358622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:59.358661 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:59.359116 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:59.359121 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:59.361185 (+ 2064us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":82,"threads_started":1}
W20260812 06:13:59.361338 16441 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:59.356540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:60205 (local address 127.0.176.254:35323)
0812 06:13:59.356674 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:59.356676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:59.356687 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:13:59.356716 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:59.356717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:59.356727 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:59.356790 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:59.357136 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.357679 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.358353 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.358547 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.358599 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:59.361267 (+ 2668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.193:60205: BlockingRecv error: recv got EOF from 127.0.176.193:60205 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":74,"threads_started":1}
Aug 12 06:13:59 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:13:59 dist-test-slave-gw5c krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.0.176.194@KRBTEST.COM for oryx/127.0.176.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:13:59.487514 16443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:59.482237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:35323 (local address 127.0.176.194:49439)
0812 06:13:59.482422 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:59.482435 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:59.482503 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:59.482671 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:59.482672 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:59.482866 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:59.482913 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:59.482915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.483682 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.483683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:59.484216 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:59.484217 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.484610 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.484612 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:59.484672 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:59.485131 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:13:59.485135 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:59.487395 (+ 2260us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.0.176.254:35323: Server oryx/127.0.176.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":101,"threads_started":1}
W20260812 06:13:59.487607 16441 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:13:59.482339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:49439 (local address 127.0.176.254:35323)
0812 06:13:59.482419 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:59.482422 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:59.482483 (+ 61us) server_negotiation.cc:407] Connection header received
0812 06:13:59.482566 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:59.482567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:59.482584 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:59.482666 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:59.483009 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.483596 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.484310 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.484531 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.484611 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:59.487542 (+ 2931us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.176.194:49439: BlockingRecv error: recv got EOF from 127.0.176.194:49439 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:13:59.526430 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 15534
I20260812 06:13:59.545254 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 15814
I20260812 06:13:59.561013 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 16067
I20260812 06:13:59.579068 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 15401
2026-08-12T06:13:59Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17929 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T06:13:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:13:59Z Disabled control of system clock
I20260812 06:13:59.614017 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43745
--webserver_interface=127.0.176.254
--webserver_port=0
--builtin_ntp_servers=127.0.176.212:46515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:43745
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 06:13:59.711210 16449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:59.711476 16449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:59.711500 16449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:59.712700 16449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:13:59.712744 16449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:59.712757 16449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:59.712770 16449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:13:59.712783 16449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:13:59.714164 16449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:46515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:43745
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:59.714403 16449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:59.714691 16449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:59.719702 16462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:59.719749 16470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:59.719733 16464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:59.720057 16449 server_base.cc:1034] running on GCE node
I20260812 06:13:59.720366 16449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:59.720685 16449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:59.721856 16449 hybrid_clock.cc:648] HybridClock initialized: now 1786515239721832 us; error 43 us; skew 500 ppm
I20260812 06:13:59.723201 16449 webserver.cc:460] Webserver started at http://127.0.176.254:34347/ using document root <none> and password file <none>
I20260812 06:13:59.723524 16449 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:59.723599 16449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:59.723747 16449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:59.724874 16449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "36bdf80a12e947e88280e177b9ec8c74"
format_stamp: "Formatted at 2026-08-12 06:13:59 on dist-test-slave-gw5c"
server_key: "73ee964130cac95509f2a36171f25690"
server_key_iv: "189de10731c1d49e8bfea70d07748a24"
server_key_version: "encryptionkey@0"
I20260812 06:13:59.725286 16449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "36bdf80a12e947e88280e177b9ec8c74"
format_stamp: "Formatted at 2026-08-12 06:13:59 on dist-test-slave-gw5c"
server_key: "73ee964130cac95509f2a36171f25690"
server_key_iv: "189de10731c1d49e8bfea70d07748a24"
server_key_version: "encryptionkey@0"
I20260812 06:13:59.726807 16449 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:13:59.727770 16477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:59.727958 16449 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:13:59.728075 16449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "36bdf80a12e947e88280e177b9ec8c74"
format_stamp: "Formatted at 2026-08-12 06:13:59 on dist-test-slave-gw5c"
server_key: "73ee964130cac95509f2a36171f25690"
server_key_iv: "189de10731c1d49e8bfea70d07748a24"
server_key_version: "encryptionkey@0"
I20260812 06:13:59.728158 16449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:59.740389 16449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:59.740780 16449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:59.740952 16449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:59.745703 16449 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:43745
I20260812 06:13:59.745741 16582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:43745 every 8 connection(s)
I20260812 06:13:59.746147 16449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:13:59.747066 16583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:13:59.749888 16583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74: Bootstrap starting.
I20260812 06:13:59.750111 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 16449
I20260812 06:13:59.750224 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:13:59.750416 707 external_mini_cluster.cc:1428] Setting key 59c4bc6b1ae0e37f23d8894b5bd87cba
I20260812 06:13:59.750730 16583 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74: Neither blocks nor log segments found. Creating new log.
I20260812 06:13:59.751113 16583 log.cc:824] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74: Log is configured to *not* fsync() on all Append() calls
I20260812 06:13:59.752002 16583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74: No bootstrap required, opened a new log
I20260812 06:13:59.753947 16583 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36bdf80a12e947e88280e177b9ec8c74" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43745 } }
I20260812 06:13:59.754130 16583 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:13:59.754159 16583 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36bdf80a12e947e88280e177b9ec8c74, State: Initialized, Role: FOLLOWER
I20260812 06:13:59.754307 16583 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36bdf80a12e947e88280e177b9ec8c74" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43745 } }
I20260812 06:13:59.754402 16583 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:13:59.754452 16583 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:13:59.754503 16583 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:13:59.755602 16583 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36bdf80a12e947e88280e177b9ec8c74" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43745 } }
I20260812 06:13:59.755720 16583 leader_election.cc:302] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36bdf80a12e947e88280e177b9ec8c74; no voters:
I20260812 06:13:59.755923 16583 leader_election.cc:288] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:13:59.756003 16589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:13:59.756220 16583 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:13:59.756284 16589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [term 1 LEADER]: Becoming Leader. State: Replica: 36bdf80a12e947e88280e177b9ec8c74, State: Running, Role: LEADER
I20260812 06:13:59.756517 16589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36bdf80a12e947e88280e177b9ec8c74" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43745 } }
I20260812 06:13:59.757440 16586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:59.751071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34148 (local address 127.0.176.254:43745)
0812 06:13:59.751373 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:59.751382 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:59.751442 (+ 60us) server_negotiation.cc:407] Connection header received
0812 06:13:59.752023 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:59.752032 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:59.752111 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:59.752271 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:59.752502 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.753910 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.754920 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.755626 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.755762 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:59.756606 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:59.756610 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:59.756610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:59.756828 (+ 218us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:59.756885 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:59.756903 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:59.756992 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:59.757128 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 06:13:59.757223 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":115,"threads_started":1}
I20260812 06:13:59.757517 16591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36bdf80a12e947e88280e177b9ec8c74. Latest consensus state: current_term: 1 leader_uuid: "36bdf80a12e947e88280e177b9ec8c74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36bdf80a12e947e88280e177b9ec8c74" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43745 } } }
I20260812 06:13:59.757617 16591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:59.758015 16614 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:13:59.758041 16590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36bdf80a12e947e88280e177b9ec8c74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36bdf80a12e947e88280e177b9ec8c74" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43745 } } }
I20260812 06:13:59.758416 16590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74 [sys.catalog]: This master's current role is: LEADER
I20260812 06:13:59.758630 16614 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:13:59.760151 16614 catalog_manager.cc:1347] Generated new cluster ID: b972556dd99e410c924c619a4bacb269
I20260812 06:13:59.760231 16614 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:13:59.769063 16614 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:13:59.770035 16614 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:13:59.775878 16614 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36bdf80a12e947e88280e177b9ec8c74: Generated new TSK 0
I20260812 06:13:59.776094 16614 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:13:59.777410 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43745
--builtin_ntp_servers=127.0.176.212:46515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 06:13:59.873318 16625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:13:59.873589 16625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:13:59.873632 16625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:13:59.874845 16625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:13:59.874924 16625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:13:59.874972 16625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:13:59.876670 16625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:46515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:13:59.876968 16625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:13:59.877313 16625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:13:59.883318 16634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:13:59.883318 16635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:59.883677 16625 server_base.cc:1034] running on GCE node
W20260812 06:13:59.883694 16637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:13:59.883944 16625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:13:59.884231 16625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:13:59.885399 16625 hybrid_clock.cc:648] HybridClock initialized: now 1786515239885378 us; error 39 us; skew 500 ppm
I20260812 06:13:59.890354 16625 webserver.cc:460] Webserver started at http://127.0.176.193:46483/ using document root <none> and password file <none>
I20260812 06:13:59.890688 16625 fs_manager.cc:359] Metadata directory not provided
I20260812 06:13:59.890743 16625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:13:59.890908 16625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:13:59.892133 16625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "3a09eeeb65bf41fcafa7d836e312548e"
format_stamp: "Formatted at 2026-08-12 06:13:59 on dist-test-slave-gw5c"
server_key: "2598b2d82099730ba81a48b4505b0fe4"
server_key_iv: "0c72467ff74a2418ea0c6cb7c1ffc3b8"
server_key_version: "encryptionkey@0"
I20260812 06:13:59.892518 16625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "3a09eeeb65bf41fcafa7d836e312548e"
format_stamp: "Formatted at 2026-08-12 06:13:59 on dist-test-slave-gw5c"
server_key: "2598b2d82099730ba81a48b4505b0fe4"
server_key_iv: "0c72467ff74a2418ea0c6cb7c1ffc3b8"
server_key_version: "encryptionkey@0"
I20260812 06:13:59.893975 16625 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:13:59.894816 16645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:59.894992 16625 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:13:59.895107 16625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "3a09eeeb65bf41fcafa7d836e312548e"
format_stamp: "Formatted at 2026-08-12 06:13:59 on dist-test-slave-gw5c"
server_key: "2598b2d82099730ba81a48b4505b0fe4"
server_key_iv: "0c72467ff74a2418ea0c6cb7c1ffc3b8"
server_key_version: "encryptionkey@0"
I20260812 06:13:59.895192 16625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:13:59.904969 16625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:13:59.905336 16625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:13:59.905508 16625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:13:59.905776 16625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:13:59.906152 16625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:13:59.906188 16625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:59.906212 16625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:13:59.906260 16625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:13:59.913365 16625 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:38025
I20260812 06:13:59.913409 16873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:38025 every 8 connection(s)
I20260812 06:13:59.913786 16625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:13:59.917243 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 16625
I20260812 06:13:59.917346 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:13:59.917565 707 external_mini_cluster.cc:1428] Setting key 0fb298f20ab359218230629e7a7125ce
I20260812 06:13:59.918497 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43745
--builtin_ntp_servers=127.0.176.212:46515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 06:13:59.919425 16586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:59.914693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:52471 (local address 127.0.176.254:43745)
0812 06:13:59.914781 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 06:13:59.914784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:13:59.915002 (+ 218us) server_negotiation.cc:407] Connection header received
0812 06:13:59.915518 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:13:59.915519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:13:59.915531 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:13:59.915607 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:13:59.916256 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.916755 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.917876 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.918084 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.918177 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:59.919104 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:13:59.919105 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:13:59.919106 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:13:59.919111 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:13:59.919127 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:13:59.919131 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:13:59.919186 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:13:59.919289 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 06:13:59.919320 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 06:13:59.919687 16879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:13:59.914644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43745 (local address 127.0.176.193:52471)
0812 06:13:59.914872 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 06:13:59.914912 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:13:59.915438 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:13:59.915655 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:13:59.915658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:13:59.915666 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:13:59.916179 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:59.916183 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.916845 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.916846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:59.917783 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:13:59.917786 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:13:59.918192 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:13:59.918193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:13:59.918335 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:13:59.918948 (+ 613us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:13:59.918948 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:13:59.918987 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:13:59.919010 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:13:59.919189 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:13:59.919194 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:13:59.919197 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:13:59.919290 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 06:13:59.919426 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":113,"threads_started":1}
I20260812 06:13:59.920197 16876 heartbeater.cc:347] Connected to a master server at 127.0.176.254:43745
I20260812 06:13:59.920320 16876 heartbeater.cc:464] Registering TS with master...
I20260812 06:13:59.920516 16876 heartbeater.cc:511] Master 127.0.176.254:43745 requested a full tablet report, sending...
I20260812 06:13:59.921072 16502 ts_manager.cc:194] Registered new tserver with Master: 3a09eeeb65bf41fcafa7d836e312548e (127.0.176.193:38025)
I20260812 06:13:59.921994 16502 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.176.193:52471
W20260812 06:14:00.006882 16880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:00.007108 16880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:00.007130 16880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:00.008363 16880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:00.008411 16880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:00.008437 16880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:14:00.009757 16880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:46515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:00.009984 16880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:00.010269 16880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:00.015349 16897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:00.015417 16893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:00.015524 16894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:00.015682 16880 server_base.cc:1034] running on GCE node
I20260812 06:14:00.015945 16880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:00.016249 16880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:00.017468 16880 hybrid_clock.cc:648] HybridClock initialized: now 1786515240017456 us; error 28 us; skew 500 ppm
I20260812 06:14:00.018971 16880 webserver.cc:460] Webserver started at http://127.0.176.194:33687/ using document root <none> and password file <none>
I20260812 06:14:00.019255 16880 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:00.019306 16880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:00.019484 16880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:14:00.020599 16880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "8a706be27a944f0986c5a06264dc5a99"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "37fc299b4f4ed76bdd5095a626cafc29"
server_key_iv: "352941a6402bcc203ef116831ceaa7f8"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.020972 16880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "8a706be27a944f0986c5a06264dc5a99"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "37fc299b4f4ed76bdd5095a626cafc29"
server_key_iv: "352941a6402bcc203ef116831ceaa7f8"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.022392 16880 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:14:00.023168 16910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.023377 16880 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:14:00.023526 16880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "8a706be27a944f0986c5a06264dc5a99"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "37fc299b4f4ed76bdd5095a626cafc29"
server_key_iv: "352941a6402bcc203ef116831ceaa7f8"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.023607 16880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:14:00.031517 16880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:00.031836 16880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:00.031991 16880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:00.032178 16880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:14:00.032596 16880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:14:00.032648 16880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.032672 16880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:14:00.032684 16880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.038849 16880 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:39599
I20260812 06:14:00.038947 17114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:39599 every 8 connection(s)
I20260812 06:14:00.039305 16880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:14:00.044534 16586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:00.040196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:46599 (local address 127.0.176.254:43745)
0812 06:14:00.040268 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:00.040270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:00.040533 (+ 263us) server_negotiation.cc:407] Connection header received
0812 06:14:00.041029 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:00.041030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:00.041040 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:00.041103 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:00.041767 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:00.042256 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:00.043202 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:00.043384 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:00.043473 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:00.044287 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:00.044288 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:00.044288 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:14:00.044293 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:00.044306 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:14:00.044310 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:00.044357 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:00.044443 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 06:14:00.044471 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 06:14:00.044749 17118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:00.040166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43745 (local address 127.0.176.194:46599)
0812 06:14:00.040391 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:00.040441 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:00.040939 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:00.041172 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:00.041175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:00.041183 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:14:00.041685 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:00.041689 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:00.042341 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:00.042342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:00.043121 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:00.043122 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:00.043488 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:00.043489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:00.043606 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:00.044157 (+ 551us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:14:00.044157 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:14:00.044185 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:14:00.044207 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:14:00.044368 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:14:00.044372 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:14:00.044375 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:14:00.044432 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:14:00.044507 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":117,"threads_started":1}
I20260812 06:14:00.045334 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 16880
I20260812 06:14:00.045377 17116 heartbeater.cc:347] Connected to a master server at 127.0.176.254:43745
I20260812 06:14:00.045454 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:14:00.045471 17116 heartbeater.cc:464] Registering TS with master...
I20260812 06:14:00.045673 17116 heartbeater.cc:511] Master 127.0.176.254:43745 requested a full tablet report, sending...
I20260812 06:14:00.045681 707 external_mini_cluster.cc:1428] Setting key 1dd603b16564fd41f77abf8c0ce0d603
I20260812 06:14:00.046371 16502 ts_manager.cc:194] Registered new tserver with Master: 8a706be27a944f0986c5a06264dc5a99 (127.0.176.194:39599)
I20260812 06:14:00.046828 16502 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.176.194:46599
I20260812 06:14:00.046998 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43745
--builtin_ntp_servers=127.0.176.212:46515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 06:14:00.131227 17119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:00.131479 17119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:00.131501 17119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:00.132771 17119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:00.132814 17119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:00.132841 17119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:14:00.134205 17119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:46515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:00.134474 17119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:00.134799 17119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:00.139931 17129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:00.139967 17136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:00.139922 17130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:00.140269 17119 server_base.cc:1034] running on GCE node
I20260812 06:14:00.140504 17119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:00.140756 17119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:00.141938 17119 hybrid_clock.cc:648] HybridClock initialized: now 1786515240141929 us; error 38 us; skew 500 ppm
I20260812 06:14:00.143270 17119 webserver.cc:460] Webserver started at http://127.0.176.195:34957/ using document root <none> and password file <none>
I20260812 06:14:00.143589 17119 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:00.143663 17119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:00.143836 17119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:14:00.144973 17119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "34bb1ae36a104ae497426028ca20744c"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "7367b7167b89ee44ef0d45775e68280e"
server_key_iv: "4171109a1a2d1b5417ac89ffdc7d02e4"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.145350 17119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "34bb1ae36a104ae497426028ca20744c"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "7367b7167b89ee44ef0d45775e68280e"
server_key_iv: "4171109a1a2d1b5417ac89ffdc7d02e4"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.146683 17119 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:14:00.147378 17142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.147593 17119 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:14:00.147692 17119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "34bb1ae36a104ae497426028ca20744c"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "7367b7167b89ee44ef0d45775e68280e"
server_key_iv: "4171109a1a2d1b5417ac89ffdc7d02e4"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.147778 17119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:14:00.178206 17119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:00.178579 17119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:00.178738 17119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:00.179011 17119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:14:00.179365 17119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:14:00.179452 17119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.179502 17119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:14:00.179527 17119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.185484 17119 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:34041
I20260812 06:14:00.185534 17348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:34041 every 8 connection(s)
I20260812 06:14:00.185921 17119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:14:00.191381 16586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:00.186754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:59749 (local address 127.0.176.254:43745)
0812 06:14:00.186827 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:00.186829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:00.187091 (+ 262us) server_negotiation.cc:407] Connection header received
0812 06:14:00.187718 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:00.187719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:00.187730 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:00.187799 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:00.188505 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:00.189016 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:00.189967 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:00.190148 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:00.190201 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:00.191119 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:00.191120 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:00.191120 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:14:00.191125 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:00.191140 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:14:00.191143 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:00.191196 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:00.191283 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 06:14:00.191314 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 06:14:00.191593 17355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:00.186743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43745 (local address 127.0.176.195:59749)
0812 06:14:00.186955 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:00.186998 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:00.187590 (+ 592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:00.187880 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:00.187884 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:00.187892 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:14:00.188411 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:00.188415 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:00.189101 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:00.189102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:00.189885 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:00.189887 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:00.190230 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:00.190230 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:00.190342 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:00.190961 (+ 619us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:14:00.190961 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:14:00.190992 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:14:00.191017 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:14:00.191209 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:14:00.191213 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:14:00.191216 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:14:00.191268 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 06:14:00.191355 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":96,"threads_started":1}
I20260812 06:14:00.192134 17350 heartbeater.cc:347] Connected to a master server at 127.0.176.254:43745
I20260812 06:14:00.192243 17350 heartbeater.cc:464] Registering TS with master...
I20260812 06:14:00.192435 17350 heartbeater.cc:511] Master 127.0.176.254:43745 requested a full tablet report, sending...
I20260812 06:14:00.192879 16502 ts_manager.cc:194] Registered new tserver with Master: 34bb1ae36a104ae497426028ca20744c (127.0.176.195:34041)
I20260812 06:14:00.192946 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 17119
I20260812 06:14:00.193087 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:14:00.193293 707 external_mini_cluster.cc:1428] Setting key 594d9d3c51a3c46ec5276f5d74420224
I20260812 06:14:00.193341 16502 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.176.195:59749
I20260812 06:14:00.194232 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 06:14:00.196197 16586 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:14:00.195681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34156 (local address 127.0.176.254:43745)
0812 06:14:00.195753 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:00.195756 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:00.195855 (+ 99us) server_negotiation.cc:407] Connection header received
0812 06:14:00.195923 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:00.195924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:00.195934 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:00.195990 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:00.196126 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34156: BlockingRecv error: recv got EOF from 127.0.0.1:34156 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:14:00.196261 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 16625
I20260812 06:14:00.212563 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 16880
I20260812 06:14:00.229311 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 17119
I20260812 06:14:00.250730 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 16449
2026-08-12T06:14:00Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (679 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T06:14:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:14:00Z Disabled control of system clock
I20260812 06:14:00.294029 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:44031
--webserver_interface=127.0.176.254
--webserver_port=0
--builtin_ntp_servers=127.0.176.212:34413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:44031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 06:14:00.378820 17374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:00.379154 17374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:00.379187 17374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:00.380667 17374 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:14:00.380745 17374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:00.380760 17374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:00.380774 17374 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:14:00.380791 17374 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:14:00.382264 17374 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:44031
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:44031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:00.382522 17374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:00.382818 17374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:00.388792 17384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:00.388851 17374 server_base.cc:1034] running on GCE node
W20260812 06:14:00.389860 17388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:00.389889 17393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:00.390246 17374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:00.390592 17374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:00.391763 17374 hybrid_clock.cc:648] HybridClock initialized: now 1786515240391759 us; error 43 us; skew 500 ppm
I20260812 06:14:00.393249 17374 webserver.cc:460] Webserver started at http://127.0.176.254:33503/ using document root <none> and password file <none>
I20260812 06:14:00.393519 17374 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:00.393595 17374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:00.393752 17374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:14:00.394891 17374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "0f2d1beaf0bc4d90a63b9963f7a6621d"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "5e18cde74aa5f141949e0795243b16ab"
server_key_iv: "f9479db4bae38b11b22e4c7ec88598bc"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.395269 17374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "0f2d1beaf0bc4d90a63b9963f7a6621d"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "5e18cde74aa5f141949e0795243b16ab"
server_key_iv: "f9479db4bae38b11b22e4c7ec88598bc"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.396728 17374 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:14:00.397512 17407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.397691 17374 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:14:00.397801 17374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "0f2d1beaf0bc4d90a63b9963f7a6621d"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "5e18cde74aa5f141949e0795243b16ab"
server_key_iv: "f9479db4bae38b11b22e4c7ec88598bc"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.397881 17374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:14:00.401518 17374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:00.401810 17374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:00.401957 17374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:00.406070 17374 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:44031
I20260812 06:14:00.406138 17490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:44031 every 8 connection(s)
I20260812 06:14:00.406625 17374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:14:00.407503 17491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:14:00.408699 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 17374
I20260812 06:14:00.408783 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:14:00.408993 707 external_mini_cluster.cc:1428] Setting key 7432e7cd608fdb6bbeb42dbf0e113c81
I20260812 06:14:00.411314 17491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d: Bootstrap starting.
I20260812 06:14:00.412006 17495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:00.409625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46642 (local address 127.0.176.254:44031)
0812 06:14:00.409846 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:00.409855 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:00.409888 (+ 33us) server_negotiation.cc:407] Connection header received
0812 06:14:00.410456 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:00.410465 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:00.410522 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:00.410675 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:00.411512 (+ 837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:00.411515 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:00.411515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:14:00.411520 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:00.411568 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:14:00.411581 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:00.411683 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:00.411746 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 06:14:00.411808 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":82,"threads_started":1}
I20260812 06:14:00.412138 17491 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d: Neither blocks nor log segments found. Creating new log.
I20260812 06:14:00.412511 17491 log.cc:824] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:14:00.413218 17491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d: No bootstrap required, opened a new log
I20260812 06:14:00.414577 17491 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2d1beaf0bc4d90a63b9963f7a6621d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44031 } }
I20260812 06:14:00.414721 17491 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:14:00.414743 17491 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f2d1beaf0bc4d90a63b9963f7a6621d, State: Initialized, Role: FOLLOWER
I20260812 06:14:00.414870 17491 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2d1beaf0bc4d90a63b9963f7a6621d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44031 } }
I20260812 06:14:00.414959 17491 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:14:00.415004 17491 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:14:00.415055 17491 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:14:00.415798 17491 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2d1beaf0bc4d90a63b9963f7a6621d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44031 } }
I20260812 06:14:00.415903 17491 leader_election.cc:302] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f2d1beaf0bc4d90a63b9963f7a6621d; no voters:
I20260812 06:14:00.416062 17491 leader_election.cc:288] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:14:00.416333 17491 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:14:00.416394 17497 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:14:00.416567 17497 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [term 1 LEADER]: Becoming Leader. State: Replica: 0f2d1beaf0bc4d90a63b9963f7a6621d, State: Running, Role: LEADER
I20260812 06:14:00.416700 17497 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2d1beaf0bc4d90a63b9963f7a6621d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44031 } }
I20260812 06:14:00.417122 17498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f2d1beaf0bc4d90a63b9963f7a6621d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2d1beaf0bc4d90a63b9963f7a6621d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44031 } } }
I20260812 06:14:00.417220 17498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [sys.catalog]: This master's current role is: LEADER
I20260812 06:14:00.417389 17502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f2d1beaf0bc4d90a63b9963f7a6621d. Latest consensus state: current_term: 1 leader_uuid: "0f2d1beaf0bc4d90a63b9963f7a6621d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2d1beaf0bc4d90a63b9963f7a6621d" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44031 } } }
I20260812 06:14:00.417469 17502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d [sys.catalog]: This master's current role is: LEADER
I20260812 06:14:00.417443 17519 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:14:00.417964 17519 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:14:00.419858 17519 catalog_manager.cc:1347] Generated new cluster ID: 1415bb2c2c5e4a0d812437c0d1f278b6
I20260812 06:14:00.419919 17519 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:14:00.441133 17519 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:14:00.441352 17519 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:14:00.449698 17519 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f2d1beaf0bc4d90a63b9963f7a6621d: Generated new TSK 0
I20260812 06:14:00.449919 17519 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:14:00.459035 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:44031
--builtin_ntp_servers=127.0.176.212:34413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 06:14:00.555227 17538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:00.555545 17538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:00.555576 17538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:00.557425 17538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:00.557480 17538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:00.557534 17538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:14:00.559036 17538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:44031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:00.559325 17538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:00.559680 17538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:00.565740 17551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:00.565726 17546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:00.565704 17558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:00.566118 17538 server_base.cc:1034] running on GCE node
I20260812 06:14:00.566376 17538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:00.566664 17538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:00.567816 17538 hybrid_clock.cc:648] HybridClock initialized: now 1786515240567804 us; error 25 us; skew 500 ppm
I20260812 06:14:00.569103 17538 webserver.cc:460] Webserver started at http://127.0.176.193:46249/ using document root <none> and password file <none>
I20260812 06:14:00.569368 17538 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:00.569448 17538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:00.569598 17538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:14:00.570781 17538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "c8ab0823e4974b6fbd7cd67f01a4dcdb"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "bdae08b01e5f34351cfa34b4e06b01e4"
server_key_iv: "2c1a02937abed5830dfb7f032079b32f"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.571172 17538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "c8ab0823e4974b6fbd7cd67f01a4dcdb"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "bdae08b01e5f34351cfa34b4e06b01e4"
server_key_iv: "2c1a02937abed5830dfb7f032079b32f"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.572633 17538 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:14:00.573350 17568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.573552 17538 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:14:00.573650 17538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "c8ab0823e4974b6fbd7cd67f01a4dcdb"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "bdae08b01e5f34351cfa34b4e06b01e4"
server_key_iv: "2c1a02937abed5830dfb7f032079b32f"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.573732 17538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:14:00.577248 17538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:00.577541 17538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:00.577682 17538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:00.577940 17538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:14:00.578270 17538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:14:00.578322 17538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.578363 17538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:14:00.578389 17538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.584458 17538 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:41173
I20260812 06:14:00.584532 17769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:41173 every 8 connection(s)
I20260812 06:14:00.584908 17538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:14:00.585770 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 17538
I20260812 06:14:00.585871 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:14:00.586129 707 external_mini_cluster.cc:1428] Setting key 9784229a34751e1f36d01e9eca412bce
I20260812 06:14:00.587186 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:44031
--builtin_ntp_servers=127.0.176.212:34413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 06:14:00.588394 17495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:00.585726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:53759 (local address 127.0.176.254:44031)
0812 06:14:00.585784 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:00.585786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:00.586053 (+ 267us) server_negotiation.cc:407] Connection header received
0812 06:14:00.586691 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:00.586692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:00.586698 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:00.586793 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:00.588124 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:00.588125 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:00.588126 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:14:00.588131 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:00.588149 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:14:00.588154 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:00.588227 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:00.588275 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 06:14:00.588293 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:14:00.588559 17772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:00.585709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:44031 (local address 127.0.176.193:53759)
0812 06:14:00.585909 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:00.585954 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:00.586597 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:00.586873 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:00.586877 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:00.586888 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:14:00.587958 (+ 1070us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:14:00.587959 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:14:00.587990 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:14:00.588021 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:14:00.588224 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:14:00.588227 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:14:00.588229 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:14:00.588283 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:14:00.588335 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":91,"threads_started":1}
I20260812 06:14:00.589331 17770 heartbeater.cc:347] Connected to a master server at 127.0.176.254:44031
I20260812 06:14:00.589452 17770 heartbeater.cc:464] Registering TS with master...
I20260812 06:14:00.589622 17770 heartbeater.cc:511] Master 127.0.176.254:44031 requested a full tablet report, sending...
I20260812 06:14:00.590209 17438 ts_manager.cc:194] Registered new tserver with Master: c8ab0823e4974b6fbd7cd67f01a4dcdb (127.0.176.193:41173)
W20260812 06:14:00.672366 17773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:00.672605 17773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:00.672629 17773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:00.673874 17773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:00.673931 17773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:00.673960 17773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:14:00.675431 17773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:44031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:00.675737 17773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:00.676072 17773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:00.681492 17780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:00.681463 17782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:00.681483 17793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:00.681658 17773 server_base.cc:1034] running on GCE node
I20260812 06:14:00.681953 17773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:00.682164 17773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:00.683339 17773 hybrid_clock.cc:648] HybridClock initialized: now 1786515240683324 us; error 28 us; skew 500 ppm
I20260812 06:14:00.684743 17773 webserver.cc:460] Webserver started at http://127.0.176.194:43685/ using document root <none> and password file <none>
I20260812 06:14:00.685011 17773 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:00.685061 17773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:00.685225 17773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:14:00.686290 17773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "e4c3b573df0949b49a750d2a8236fb84"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "012438a2682fa2c2f2d9eb2e22c0ea46"
server_key_iv: "2bd81bd84453a08025c4849ed0b44977"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.686650 17773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "e4c3b573df0949b49a750d2a8236fb84"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "012438a2682fa2c2f2d9eb2e22c0ea46"
server_key_iv: "2bd81bd84453a08025c4849ed0b44977"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.688056 17773 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:14:00.688827 17810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.689028 17773 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:14:00.689126 17773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "e4c3b573df0949b49a750d2a8236fb84"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "012438a2682fa2c2f2d9eb2e22c0ea46"
server_key_iv: "2bd81bd84453a08025c4849ed0b44977"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.689213 17773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:14:00.692708 17773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:00.692991 17773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:00.693125 17773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:00.693352 17773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:14:00.693657 17773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:14:00.693689 17773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.693737 17773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:14:00.693765 17773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.699601 17773 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:42165
I20260812 06:14:00.699654 18010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:42165 every 8 connection(s)
I20260812 06:14:00.699996 17773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:14:00.703130 17495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:00.700719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:53099 (local address 127.0.176.254:44031)
0812 06:14:00.700788 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:00.700791 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:00.701020 (+ 229us) server_negotiation.cc:407] Connection header received
0812 06:14:00.701538 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:00.701540 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:00.701548 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:00.701615 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:00.702862 (+ 1247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:00.702864 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:00.702864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:14:00.702869 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:00.702885 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:14:00.702889 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:00.702944 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:00.703037 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 06:14:00.703054 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 06:14:00.703331 18016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:00.700723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:44031 (local address 127.0.176.194:53099)
0812 06:14:00.700895 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:00.700937 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:00.701431 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:00.701691 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:00.701694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:00.701701 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:14:00.702710 (+ 1009us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:14:00.702711 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:14:00.702739 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:14:00.702768 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:14:00.702942 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:14:00.702948 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:14:00.702951 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:14:00.703046 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 06:14:00.703108 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260812 06:14:00.703706 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 17773
I20260812 06:14:00.703833 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:14:00.703861 18012 heartbeater.cc:347] Connected to a master server at 127.0.176.254:44031
I20260812 06:14:00.703972 18012 heartbeater.cc:464] Registering TS with master...
I20260812 06:14:00.704069 707 external_mini_cluster.cc:1428] Setting key 2b0e1288420588e8d8f3c10408eac06c
I20260812 06:14:00.704120 18012 heartbeater.cc:511] Master 127.0.176.254:44031 requested a full tablet report, sending...
I20260812 06:14:00.704516 17435 ts_manager.cc:194] Registered new tserver with Master: e4c3b573df0949b49a750d2a8236fb84 (127.0.176.194:42165)
I20260812 06:14:00.704968 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:44031
--builtin_ntp_servers=127.0.176.212:34413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 06:14:00.787680 18017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:00.787925 18017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:00.787962 18017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:00.789105 18017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:00.789175 18017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:00.789222 18017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:14:00.790568 18017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:44031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:00.790835 18017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:00.791128 18017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:00.796144 18032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:00.796106 18027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:00.796211 18017 server_base.cc:1034] running on GCE node
W20260812 06:14:00.796109 18036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:00.796586 18017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:00.796864 18017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:00.798030 18017 hybrid_clock.cc:648] HybridClock initialized: now 1786515240798019 us; error 42 us; skew 500 ppm
I20260812 06:14:00.799232 18017 webserver.cc:460] Webserver started at http://127.0.176.195:34357/ using document root <none> and password file <none>
I20260812 06:14:00.799520 18017 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:00.799587 18017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:00.799742 18017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:14:00.800891 18017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "5af0ab378943423f8fcf13216e8f987a"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "a30480f545da7ec5d793bb2a326ca29c"
server_key_iv: "3ad338da5bbd34fa22205a6f109aaf98"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.801290 18017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "5af0ab378943423f8fcf13216e8f987a"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "a30480f545da7ec5d793bb2a326ca29c"
server_key_iv: "3ad338da5bbd34fa22205a6f109aaf98"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.802703 18017 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:14:00.803540 18048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.803730 18017 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:14:00.803828 18017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "5af0ab378943423f8fcf13216e8f987a"
format_stamp: "Formatted at 2026-08-12 06:14:00 on dist-test-slave-gw5c"
server_key: "a30480f545da7ec5d793bb2a326ca29c"
server_key_iv: "3ad338da5bbd34fa22205a6f109aaf98"
server_key_version: "encryptionkey@0"
I20260812 06:14:00.803918 18017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:14:00.807246 18017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:00.807549 18017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:00.807699 18017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:00.807919 18017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:14:00.808243 18017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:14:00.808295 18017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.808336 18017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:14:00.808362 18017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:00.814363 18017 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:45671
I20260812 06:14:00.814399 18244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:45671 every 8 connection(s)
I20260812 06:14:00.814752 18017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:14:00.817942 17495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:00.815506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:49155 (local address 127.0.176.254:44031)
0812 06:14:00.815577 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:00.815579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:00.815911 (+ 332us) server_negotiation.cc:407] Connection header received
0812 06:14:00.816448 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:00.816450 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:00.816456 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:00.816508 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:00.817700 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:00.817702 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:00.817702 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:14:00.817707 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:00.817721 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:14:00.817725 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:00.817792 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:00.817868 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 06:14:00.817885 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:14:00.818141 18248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:00.815548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:44031 (local address 127.0.176.195:49155)
0812 06:14:00.815762 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:00.815817 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:00.816351 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:00.816562 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:00.816565 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:00.816573 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:14:00.817541 (+ 968us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:14:00.817542 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:14:00.817571 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:14:00.817598 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:14:00.817800 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:14:00.817804 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:14:00.817806 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:14:00.817875 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:14:00.817922 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":113,"threads_started":1}
I20260812 06:14:00.818602 18245 heartbeater.cc:347] Connected to a master server at 127.0.176.254:44031
I20260812 06:14:00.818675 18245 heartbeater.cc:464] Registering TS with master...
I20260812 06:14:00.818835 18245 heartbeater.cc:511] Master 127.0.176.254:44031 requested a full tablet report, sending...
I20260812 06:14:00.819249 17435 ts_manager.cc:194] Registered new tserver with Master: 5af0ab378943423f8fcf13216e8f987a (127.0.176.195:45671)
I20260812 06:14:00.820544 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 18017
I20260812 06:14:00.820639 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:14:00.820802 707 external_mini_cluster.cc:1428] Setting key 892eaadf6ff054effdb99100184688b6
I20260812 06:14:00.821645 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 06:14:00.823344 17495 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:14:00.822888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46658 (local address 127.0.176.254:44031)
0812 06:14:00.822945 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:00.822947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:00.823081 (+ 134us) server_negotiation.cc:407] Connection header received
0812 06:14:00.823133 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:00.823134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:00.823137 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:00.823185 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:00.823273 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46658: BlockingRecv error: recv got EOF from 127.0.0.1:46658 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:14:00.823472 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 17538
I20260812 06:14:00.844177 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 17773
I20260812 06:14:00.853529 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 18017
I20260812 06:14:00.875200 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 17374
2026-08-12T06:14:00Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (617 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:14:00 dist-test-slave-gw5c krb5kdc[18260](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:14:00 dist-test-slave-gw5c krb5kdc[18260](info): set up 2 sockets
Aug 12 06:14:00 dist-test-slave-gw5c krb5kdc[18260](info): commencing operation
krb5kdc: starting...
W20260812 06:14:02.164103 707 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:14:02 dist-test-slave-gw5c krb5kdc[18260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515242, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:14:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:14:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:14:02.291847 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:44723
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:44249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:44723
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:14:02.376675 18276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:02.376909 18276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:02.376933 18276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:02.378154 18276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:14:02.378208 18276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:02.378224 18276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:02.378237 18276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:14:02.378250 18276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:14:02.379892 18276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:44249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:44723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:44723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:02.380184 18276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:02.380446 18276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:02.386288 18281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:02.386361 18284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:02.386288 18290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:02.386715 18276 server_base.cc:1034] running on GCE node
I20260812 06:14:02.386993 18276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:02.387359 18276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:02.388556 18276 hybrid_clock.cc:648] HybridClock initialized: now 1786515242388524 us; error 46 us; skew 500 ppm
Aug 12 06:14:02 dist-test-slave-gw5c krb5kdc[18260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515242, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:14:02.395872 18276 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:14:02.396446 18276 webserver.cc:460] Webserver started at http://127.0.176.254:44359/ using document root <none> and password file <none>
I20260812 06:14:02.396713 18276 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:02.396785 18276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:02.396938 18276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:14:02.398098 18276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "759c29acf784447e8421371a42881d6c"
format_stamp: "Formatted at 2026-08-12 06:14:02 on dist-test-slave-gw5c"
server_key: "ad602fc76ce8c6f93f474c3659da166a"
server_key_iv: "16418faeb57add5211ec58b43ee70734"
server_key_version: "encryptionkey@0"
I20260812 06:14:02.398496 18276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "759c29acf784447e8421371a42881d6c"
format_stamp: "Formatted at 2026-08-12 06:14:02 on dist-test-slave-gw5c"
server_key: "ad602fc76ce8c6f93f474c3659da166a"
server_key_iv: "16418faeb57add5211ec58b43ee70734"
server_key_version: "encryptionkey@0"
I20260812 06:14:02.400041 18276 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:14:02.400830 18307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:02.401005 18276 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:14:02.401114 18276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "759c29acf784447e8421371a42881d6c"
format_stamp: "Formatted at 2026-08-12 06:14:02 on dist-test-slave-gw5c"
server_key: "ad602fc76ce8c6f93f474c3659da166a"
server_key_iv: "16418faeb57add5211ec58b43ee70734"
server_key_version: "encryptionkey@0"
I20260812 06:14:02.401197 18276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:14:02.416079 18276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:02.418503 18276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:02.418701 18276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:02.423434 18276 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:44723
I20260812 06:14:02.423478 18400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:44723 every 8 connection(s)
I20260812 06:14:02.423872 18276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:14:02.424932 18401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:14:02.427428 18401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c: Bootstrap starting.
I20260812 06:14:02.427975 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 18276
I20260812 06:14:02.428043 18401 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c: Neither blocks nor log segments found. Creating new log.
I20260812 06:14:02.428094 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:14:02.428287 707 external_mini_cluster.cc:1428] Setting key 874a05ed46c2ecd3156d661c73f03c40
I20260812 06:14:02.428406 18401 log.cc:824] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:14:02.429313 18401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c: No bootstrap required, opened a new log
I20260812 06:14:02.431908 18401 raft_consensus.cc:348] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759c29acf784447e8421371a42881d6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44723 } }
I20260812 06:14:02.432109 18401 raft_consensus.cc:374] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:14:02.432147 18401 raft_consensus.cc:729] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 759c29acf784447e8421371a42881d6c, State: Initialized, Role: FOLLOWER
I20260812 06:14:02.432276 18401 consensus_queue.cc:260] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759c29acf784447e8421371a42881d6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44723 } }
I20260812 06:14:02.432363 18401 raft_consensus.cc:388] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:14:02.432392 18401 raft_consensus.cc:482] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:14:02.432446 18401 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:14:02.433106 18401 raft_consensus.cc:504] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759c29acf784447e8421371a42881d6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44723 } }
I20260812 06:14:02.433229 18401 leader_election.cc:302] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 759c29acf784447e8421371a42881d6c; no voters:
I20260812 06:14:02.433439 18401 leader_election.cc:288] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:14:02.433648 18409 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:14:02.433744 18401 sys_catalog.cc:564] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:14:02.433837 18409 raft_consensus.cc:686] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [term 1 LEADER]: Becoming Leader. State: Replica: 759c29acf784447e8421371a42881d6c, State: Running, Role: LEADER
I20260812 06:14:02.433928 18409 consensus_queue.cc:237] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759c29acf784447e8421371a42881d6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44723 } }
I20260812 06:14:02.434259 18409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 759c29acf784447e8421371a42881d6c. Latest consensus state: current_term: 1 leader_uuid: "759c29acf784447e8421371a42881d6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759c29acf784447e8421371a42881d6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44723 } } }
I20260812 06:14:02.434363 18409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [sys.catalog]: This master's current role is: LEADER
I20260812 06:14:02.434274 18412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "759c29acf784447e8421371a42881d6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "759c29acf784447e8421371a42881d6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 44723 } } }
I20260812 06:14:02.434536 18412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c [sys.catalog]: This master's current role is: LEADER
Aug 12 06:14:02 dist-test-slave-gw5c krb5kdc[18260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515242, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
W20260812 06:14:02.435794 18446 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:14:02.435885 18446 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:14:02.436004 18426 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:14:02.436187 18426 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:14:02.437945 18426 catalog_manager.cc:1347] Generated new cluster ID: 5fb84e3254244dc59b14345d14e73e85
I20260812 06:14:02.438010 18426 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:14:02.440022 18407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:02.428846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47686 (local address 127.0.176.254:44723)
0812 06:14:02.429052 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:02.429066 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:02.429097 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:14:02.429631 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:02.429638 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:02.429689 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:02.429811 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:02.430641 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.431590 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.432607 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.433009 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.433093 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:02.436336 (+ 3243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:02.436340 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:02.436341 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:14:02.436354 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:02.438392 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:02.438789 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:02.438793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:02.438793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:02.438891 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:02.439114 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:02.439115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:02.439115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:02.439361 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:02.439568 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:02.439658 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 06:14:02.439800 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":98,"threads_started":1}
I20260812 06:14:02.480018 18426 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:14:02.480615 18426 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:14:02.484772 18426 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c: Generated new TSK 0
I20260812 06:14:02.484967 18426 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:14:02.517988 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:44723
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:44249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:14:02.606117 18455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:02.606350 18455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:02.606377 18455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:02.607540 18455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:02.607577 18455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:02.607604 18455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:14:02.609063 18455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:44249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:44723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:02.609277 18455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:02.609463 18455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:02.614718 18463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:02.614740 18467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:02.614740 18462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:02.614986 18455 server_base.cc:1034] running on GCE node
I20260812 06:14:02.615269 18455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:02.615545 18455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:02.616755 18455 hybrid_clock.cc:648] HybridClock initialized: now 1786515242616744 us; error 35 us; skew 500 ppm
Aug 12 06:14:02 dist-test-slave-gw5c krb5kdc[18260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515242, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:14:02.619609 18455 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:14:02.620237 18455 webserver.cc:460] Webserver started at http://127.0.176.193:33031/ using document root <none> and password file <none>
I20260812 06:14:02.620528 18455 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:02.620592 18455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:02.620752 18455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:14:02.621863 18455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "504b7140adbc46cbbd2e249d4dd6de19"
format_stamp: "Formatted at 2026-08-12 06:14:02 on dist-test-slave-gw5c"
server_key: "1cc129dd451aa3512f8b1af3dd9e4984"
server_key_iv: "a0269c4f340f2d1d340a8631660e88d3"
server_key_version: "encryptionkey@0"
I20260812 06:14:02.622251 18455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "504b7140adbc46cbbd2e249d4dd6de19"
format_stamp: "Formatted at 2026-08-12 06:14:02 on dist-test-slave-gw5c"
server_key: "1cc129dd451aa3512f8b1af3dd9e4984"
server_key_iv: "a0269c4f340f2d1d340a8631660e88d3"
server_key_version: "encryptionkey@0"
I20260812 06:14:02.623765 18455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:14:02.624567 18477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:02.624730 18455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:14:02.624827 18455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "504b7140adbc46cbbd2e249d4dd6de19"
format_stamp: "Formatted at 2026-08-12 06:14:02 on dist-test-slave-gw5c"
server_key: "1cc129dd451aa3512f8b1af3dd9e4984"
server_key_iv: "a0269c4f340f2d1d340a8631660e88d3"
server_key_version: "encryptionkey@0"
I20260812 06:14:02.624887 18455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:14:02.645782 18455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:02.648548 18455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:02.648690 18455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:02.648919 18455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:14:02.649330 18455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:14:02.649370 18455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:02.649396 18455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:14:02.649410 18455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:02.655628 18455 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:38953
I20260812 06:14:02.655735 18662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:38953 every 8 connection(s)
I20260812 06:14:02.656075 18455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:14:02 dist-test-slave-gw5c krb5kdc[18260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515242, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:14:02.664567 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 18455
I20260812 06:14:02.664717 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:14:02.664913 707 external_mini_cluster.cc:1428] Setting key 36eb03f76f30897b05a130d9f7b463ae
I20260812 06:14:02.666465 18407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:02.656871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:39307 (local address 127.0.176.254:44723)
0812 06:14:02.656967 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:02.656969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:02.657148 (+ 179us) server_negotiation.cc:407] Connection header received
0812 06:14:02.657717 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:02.657719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:02.657732 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:02.657800 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:02.658832 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.659366 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.660405 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.660616 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.660716 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:02.663133 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:02.663135 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:02.663135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:14:02.663148 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:02.664912 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:02.665388 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:02.665389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:02.665389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:02.665457 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:02.665747 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:02.665748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:02.665749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:02.665875 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:02.665966 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:02.666265 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 06:14:02.666366 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 06:14:02.666690 18665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:02.656841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:44723 (local address 127.0.176.193:39307)
0812 06:14:02.657008 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:02.657060 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:02.657607 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:02.657879 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:02.657883 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:02.658511 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:14:02.658720 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:02.658725 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.659500 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.659501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:02.660309 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:02.660312 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.660730 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.660731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:02.660870 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:02.661409 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:14:02.661418 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:14:02.663018 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:14:02.665016 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:14:02.665027 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:14:02.665029 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:14:02.665317 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:14:02.665528 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:14:02.665529 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:14:02.665529 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:14:02.665664 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:14:02.665956 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:14:02.665965 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:14:02.666121 (+ 156us) client_negotiation.cc:769] Sending connection context
0812 06:14:02.666231 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 06:14:02.666419 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260812 06:14:02.667212 18663 heartbeater.cc:347] Connected to a master server at 127.0.176.254:44723
I20260812 06:14:02.667325 18663 heartbeater.cc:464] Registering TS with master...
I20260812 06:14:02.667543 18663 heartbeater.cc:511] Master 127.0.176.254:44723 requested a full tablet report, sending...
I20260812 06:14:02.668102 18343 ts_manager.cc:194] Registered new tserver with Master: 504b7140adbc46cbbd2e249d4dd6de19 (127.0.176.193:38953)
I20260812 06:14:02.668768 18343 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:39307
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:14:02.693737 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:44723
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:44249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:14:02.777962 18668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:02.778199 18668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:02.778227 18668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:02.779558 18668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:02.779609 18668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:02.779639 18668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:14:02.781194 18668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:44249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:44723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:02.781458 18668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:02.781711 18668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:02.787031 18681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:02.787200 18668 server_base.cc:1034] running on GCE node
W20260812 06:14:02.787030 18678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:02.787026 18684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:02.787560 18668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:02.787870 18668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:02.789016 18668 hybrid_clock.cc:648] HybridClock initialized: now 1786515242789003 us; error 31 us; skew 500 ppm
Aug 12 06:14:02 dist-test-slave-gw5c krb5kdc[18260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515242, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:14:02.791779 18668 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:14:02.792284 18668 webserver.cc:460] Webserver started at http://127.0.176.194:42827/ using document root <none> and password file <none>
I20260812 06:14:02.792539 18668 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:02.792588 18668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:02.792718 18668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:14:02.793799 18668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "424d9538a6f44614ad8e2c56ff92d973"
format_stamp: "Formatted at 2026-08-12 06:14:02 on dist-test-slave-gw5c"
server_key: "e50fbfc3998721d2fdec4a619baf9277"
server_key_iv: "8ace919d978a0c2a5e99b09b275c7b6e"
server_key_version: "encryptionkey@0"
I20260812 06:14:02.794163 18668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "424d9538a6f44614ad8e2c56ff92d973"
format_stamp: "Formatted at 2026-08-12 06:14:02 on dist-test-slave-gw5c"
server_key: "e50fbfc3998721d2fdec4a619baf9277"
server_key_iv: "8ace919d978a0c2a5e99b09b275c7b6e"
server_key_version: "encryptionkey@0"
I20260812 06:14:02.795575 18668 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:14:02.796550 18693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:02.796798 18668 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:14:02.796906 18668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "424d9538a6f44614ad8e2c56ff92d973"
format_stamp: "Formatted at 2026-08-12 06:14:02 on dist-test-slave-gw5c"
server_key: "e50fbfc3998721d2fdec4a619baf9277"
server_key_iv: "8ace919d978a0c2a5e99b09b275c7b6e"
server_key_version: "encryptionkey@0"
I20260812 06:14:02.796985 18668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:14:02.808540 18668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:02.810685 18668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:02.810864 18668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:02.811151 18668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:14:02.811542 18668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:14:02.811596 18668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:02.811633 18668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:14:02.811661 18668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:02.817970 18668 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:41003
I20260812 06:14:02.818007 18915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:41003 every 8 connection(s)
I20260812 06:14:02.818367 18668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:14:02.820139 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 18668
I20260812 06:14:02.820263 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:14:02.820487 707 external_mini_cluster.cc:1428] Setting key cf2595e9b3ad0bf8d7c6604bb185b85d
Aug 12 06:14:02 dist-test-slave-gw5c krb5kdc[18260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515242, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:14:02.829882 18407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:02.819427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:54223 (local address 127.0.176.254:44723)
0812 06:14:02.819490 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:02.819493 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:02.819712 (+ 219us) server_negotiation.cc:407] Connection header received
0812 06:14:02.820482 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:02.820483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:02.820512 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:02.820572 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:02.821927 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.822423 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.823793 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.824126 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.824210 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:02.826787 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:02.826789 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:02.826789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:14:02.826798 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:02.828353 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:02.828837 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:02.828838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:02.828839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:02.828937 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:02.829192 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:02.829193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:02.829193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:02.829329 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:02.829402 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:02.829695 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 06:14:02.829781 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:14:02.830102 18922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:02.819346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:44723 (local address 127.0.176.194:54223)
0812 06:14:02.819580 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:02.819628 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:02.820362 (+ 734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:02.820692 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:02.820697 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:02.821547 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:14:02.821827 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:02.821833 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.822518 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.822519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:02.823710 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:02.823713 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.824215 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.824216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:02.824360 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:02.824927 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:14:02.824946 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:14:02.826690 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:14:02.828440 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:14:02.828449 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:14:02.828452 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:14:02.828689 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:14:02.829008 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:14:02.829009 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:14:02.829009 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:14:02.829126 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:14:02.829403 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:14:02.829412 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:14:02.829557 (+ 145us) client_negotiation.cc:769] Sending connection context
0812 06:14:02.829660 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 06:14:02.829847 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":131,"threads_started":1}
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
I20260812 06:14:02.830621 18916 heartbeater.cc:347] Connected to a master server at 127.0.176.254:44723
I20260812 06:14:02.830735 18916 heartbeater.cc:464] Registering TS with master...
I20260812 06:14:02.830921 18916 heartbeater.cc:511] Master 127.0.176.254:44723 requested a full tablet report, sending...
I20260812 06:14:02.831346 18343 ts_manager.cc:194] Registered new tserver with Master: 424d9538a6f44614ad8e2c56ff92d973 (127.0.176.194:41003)
I20260812 06:14:02.831777 18343 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:54223
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:14:02.847815 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:44723
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:44249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:14:02.934178 18927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:02.934429 18927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:02.934471 18927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:02.936081 18927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:02.936156 18927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:02.936205 18927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:14:02.937821 18927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:44249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:44723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:02.938114 18927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:02.938374 18927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:02.943552 18938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:02.943529 18941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:02.943560 18933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:02.943830 18927 server_base.cc:1034] running on GCE node
I20260812 06:14:02.944214 18927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:02.944505 18927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:02.945713 18927 hybrid_clock.cc:648] HybridClock initialized: now 1786515242945697 us; error 39 us; skew 500 ppm
Aug 12 06:14:02 dist-test-slave-gw5c krb5kdc[18260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515242, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:14:02.948633 18927 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:14:02.949126 18927 webserver.cc:460] Webserver started at http://127.0.176.195:44699/ using document root <none> and password file <none>
I20260812 06:14:02.949385 18927 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:02.949461 18927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:02.949613 18927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:14:02.950718 18927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "0b7fca79063e4a45af1d9256ac095258"
format_stamp: "Formatted at 2026-08-12 06:14:02 on dist-test-slave-gw5c"
server_key: "ada8756bc942b59452a7388fc6faf55c"
server_key_iv: "254e181c361096a8de86a36505fd87fb"
server_key_version: "encryptionkey@0"
I20260812 06:14:02.951087 18927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "0b7fca79063e4a45af1d9256ac095258"
format_stamp: "Formatted at 2026-08-12 06:14:02 on dist-test-slave-gw5c"
server_key: "ada8756bc942b59452a7388fc6faf55c"
server_key_iv: "254e181c361096a8de86a36505fd87fb"
server_key_version: "encryptionkey@0"
I20260812 06:14:02.952566 18927 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260812 06:14:02.953387 18953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:02.953554 18927 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:14:02.953653 18927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "0b7fca79063e4a45af1d9256ac095258"
format_stamp: "Formatted at 2026-08-12 06:14:02 on dist-test-slave-gw5c"
server_key: "ada8756bc942b59452a7388fc6faf55c"
server_key_iv: "254e181c361096a8de86a36505fd87fb"
server_key_version: "encryptionkey@0"
I20260812 06:14:02.953733 18927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:14:02.973898 18927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:02.976158 18927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:02.976361 18927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:02.976656 18927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:14:02.976995 18927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:14:02.977051 18927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:02.977087 18927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:14:02.977129 18927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:02.983623 18927 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:37225
I20260812 06:14:02.983697 19167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:37225 every 8 connection(s)
I20260812 06:14:02.984100 18927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:14:02 dist-test-slave-gw5c krb5kdc[18260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515242, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:14:02.993947 18407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:02.984909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:39361 (local address 127.0.176.254:44723)
0812 06:14:02.984977 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:02.984980 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:02.985236 (+ 256us) server_negotiation.cc:407] Connection header received
0812 06:14:02.985728 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:02.985730 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:02.985741 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:02.985797 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:02.986792 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.987380 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.988487 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.988690 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.988773 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:02.991222 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:02.991224 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:02.991225 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:14:02.991232 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:02.992729 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:02.993143 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:02.993144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:02.993144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:02.993196 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:02.993407 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:02.993407 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:02.993408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:02.993523 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:02.993574 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:02.993810 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 06:14:02.993876 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:14:02.994091 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 18927
I20260812 06:14:02.994191 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:14:02.994304 19173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:02.984908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:44723 (local address 127.0.176.195:39361)
0812 06:14:02.985102 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:02.985141 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:02.985638 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:02.985849 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:02.985853 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:02.986469 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:14:02.986680 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:02.986684 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.987540 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.987545 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:02.988385 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:02.988387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:02.988811 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:02.988812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:02.988928 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:02.989549 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:14:02.989557 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:14:02.991111 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:14:02.992824 (+ 1713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:14:02.992831 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:14:02.992834 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:14:02.993072 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:14:02.993252 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:14:02.993253 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:14:02.993253 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:14:02.993355 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:14:02.993575 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:14:02.993580 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:14:02.993703 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 06:14:02.993789 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 06:14:02.994025 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":98,"threads_started":1}
I20260812 06:14:02.994405 707 external_mini_cluster.cc:1428] Setting key 87825f41e3689fbe788d12a5ecd0df76
I20260812 06:14:02.994980 19169 heartbeater.cc:347] Connected to a master server at 127.0.176.254:44723
I20260812 06:14:02.995271 19169 heartbeater.cc:464] Registering TS with master...
I20260812 06:14:02.995529 19169 heartbeater.cc:511] Master 127.0.176.254:44723 requested a full tablet report, sending...
I20260812 06:14:02.995920 18342 ts_manager.cc:194] Registered new tserver with Master: 0b7fca79063e4a45af1d9256ac095258 (127.0.176.195:37225)
I20260812 06:14:02.996320 18342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:39361
I20260812 06:14:03.006481 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:14:03.016017 18407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.009041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47694 (local address 127.0.176.254:44723)
0812 06:14:03.009115 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:03.009117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:03.009126 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:14:03.009151 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:03.009152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:03.009167 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:03.009218 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:03.009828 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.010441 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.011197 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.011509 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.011751 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:03.013237 (+ 1486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:03.013239 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:03.013239 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:14:03.013247 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:03.014737 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:03.015122 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:03.015124 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:03.015124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:03.015189 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:03.015416 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:03.015417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:03.015417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:03.015602 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:03.015713 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:03.015817 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 06:14:03.015906 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:14:03.017709 18342 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47694:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:14:03.019717 18342 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:14:03.026908 19193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.022253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59970 (local address 127.0.176.194:41003)
0812 06:14:03.022820 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:03.022824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:03.022833 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:14:03.022870 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:03.022872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:03.022888 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:03.022992 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:14:03.023222 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.024444 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.025713 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.026500 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.026591 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:03.026663 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:03.026793 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 06:14:03.026832 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":84,"threads_started":1}
I20260812 06:14:03.026916 19191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.022142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:41003 (local address 127.0.0.1:59970)
0812 06:14:03.022354 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:03.022397 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:03.022473 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:03.023021 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:03.023024 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:03.023028 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:14:03.023110 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:03.023112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.024559 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.024561 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:03.025611 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:03.025613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.026588 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.026589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:03.026676 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:03.026692 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 06:14:03.026771 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 06:14:03.026830 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":78,"threads_started":1}
I20260812 06:14:03.027511 19192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.022171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:38953 (local address 127.0.0.1:38324)
0812 06:14:03.022660 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:03.022670 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:03.022713 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:03.023260 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:03.023261 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:03.023263 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:14:03.023320 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:03.023322 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.024223 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.024224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:03.025585 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:03.025589 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.027201 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.027202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:03.027297 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:03.027304 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 06:14:03.027365 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:14:03.027438 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":32,"spinlock_wait_cycles":896,"thread_start_us":124,"threads_started":1}
I20260812 06:14:03.027758 19194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.022470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38324 (local address 127.0.176.193:38953)
0812 06:14:03.023112 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:03.023116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:03.023127 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:14:03.023165 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:03.023167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:03.023182 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:03.023260 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:14:03.023379 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.024114 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.025713 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.026496 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.026591 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:03.026663 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:03.027422 (+ 759us) server_negotiation.cc:299] Negotiation successful
0812 06:14:03.027477 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":85,"threads_started":1}
I20260812 06:14:03.027853 18793 tablet_service.cc:1467] Processing CreateTablet for tablet c3bd1d1647ca4f2b9e39e2b65b5511b8 (DEFAULT_TABLE table=test-table [id=c05837306c964ec4baf001b176bc601a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:14:03.028298 18793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3bd1d1647ca4f2b9e39e2b65b5511b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:14:03.028463 18563 tablet_service.cc:1467] Processing CreateTablet for tablet c3bd1d1647ca4f2b9e39e2b65b5511b8 (DEFAULT_TABLE table=test-table [id=c05837306c964ec4baf001b176bc601a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:14:03.028792 18563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3bd1d1647ca4f2b9e39e2b65b5511b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:14:03.032240 19190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.022171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:37225 (local address 127.0.0.1:48208)
0812 06:14:03.022577 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:03.022586 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:03.022623 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:03.023097 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:03.023098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:03.023100 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:14:03.023131 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:03.023134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.025706 (+ 2572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.025707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:03.026388 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:03.026389 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.031890 (+ 5501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.031892 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:03.031981 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:03.031987 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:14:03.032079 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 06:14:03.032138 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":133,"threads_started":1}
I20260812 06:14:03.032225 19197 tablet_bootstrap.cc:492] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973: Bootstrap starting.
I20260812 06:14:03.032428 19196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.022484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48208 (local address 127.0.176.195:37225)
0812 06:14:03.022749 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:03.022755 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:03.022765 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:14:03.022807 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:03.022810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:03.022828 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:03.022960 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:14:03.023222 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.024444 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.026482 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.031749 (+ 5267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.031874 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:03.031955 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:03.032253 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 06:14:03.032316 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":86,"threads_started":1}
I20260812 06:14:03.032970 19197 tablet_bootstrap.cc:654] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973: Neither blocks nor log segments found. Creating new log.
I20260812 06:14:03.033174 19041 tablet_service.cc:1467] Processing CreateTablet for tablet c3bd1d1647ca4f2b9e39e2b65b5511b8 (DEFAULT_TABLE table=test-table [id=c05837306c964ec4baf001b176bc601a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:14:03.033417 19197 log.cc:824] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973: Log is configured to *not* fsync() on all Append() calls
I20260812 06:14:03.033551 19041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3bd1d1647ca4f2b9e39e2b65b5511b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:14:03.033819 19198 tablet_bootstrap.cc:492] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19: Bootstrap starting.
I20260812 06:14:03.034488 19198 tablet_bootstrap.cc:654] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19: Neither blocks nor log segments found. Creating new log.
I20260812 06:14:03.035009 19198 log.cc:824] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19: Log is configured to *not* fsync() on all Append() calls
I20260812 06:14:03.035638 19197 tablet_bootstrap.cc:492] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973: No bootstrap required, opened a new log
I20260812 06:14:03.035699 19197 ts_tablet_manager.cc:1397] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 06:14:03.036762 19205 tablet_bootstrap.cc:492] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258: Bootstrap starting.
I20260812 06:14:03.037488 19205 tablet_bootstrap.cc:654] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258: Neither blocks nor log segments found. Creating new log.
I20260812 06:14:03.037410 19197 raft_consensus.cc:348] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "424d9538a6f44614ad8e2c56ff92d973" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41003 } } peers { permanent_uuid: "504b7140adbc46cbbd2e249d4dd6de19" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38953 } } peers { permanent_uuid: "0b7fca79063e4a45af1d9256ac095258" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37225 } }
I20260812 06:14:03.037647 19197 raft_consensus.cc:374] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:14:03.037698 19197 raft_consensus.cc:729] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 424d9538a6f44614ad8e2c56ff92d973, State: Initialized, Role: FOLLOWER
I20260812 06:14:03.037850 19197 consensus_queue.cc:260] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "424d9538a6f44614ad8e2c56ff92d973" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41003 } } peers { permanent_uuid: "504b7140adbc46cbbd2e249d4dd6de19" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38953 } } peers { permanent_uuid: "0b7fca79063e4a45af1d9256ac095258" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37225 } }
I20260812 06:14:03.038103 19205 log.cc:824] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258: Log is configured to *not* fsync() on all Append() calls
I20260812 06:14:03.038173 19197 ts_tablet_manager.cc:1428] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:14:03.038650 19198 tablet_bootstrap.cc:492] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19: No bootstrap required, opened a new log
I20260812 06:14:03.038712 19198 ts_tablet_manager.cc:1397] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 06:14:03.038895 19205 tablet_bootstrap.cc:492] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258: No bootstrap required, opened a new log
I20260812 06:14:03.038992 19205 ts_tablet_manager.cc:1397] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:14:03.039535 18916 heartbeater.cc:503] Master 127.0.176.254:44723 was elected leader, sending a full tablet report...
I20260812 06:14:03.040316 19198 raft_consensus.cc:348] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "424d9538a6f44614ad8e2c56ff92d973" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41003 } } peers { permanent_uuid: "504b7140adbc46cbbd2e249d4dd6de19" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38953 } } peers { permanent_uuid: "0b7fca79063e4a45af1d9256ac095258" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37225 } }
I20260812 06:14:03.040534 19198 raft_consensus.cc:374] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:14:03.040587 19198 raft_consensus.cc:729] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504b7140adbc46cbbd2e249d4dd6de19, State: Initialized, Role: FOLLOWER
I20260812 06:14:03.040771 19198 consensus_queue.cc:260] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "424d9538a6f44614ad8e2c56ff92d973" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41003 } } peers { permanent_uuid: "504b7140adbc46cbbd2e249d4dd6de19" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38953 } } peers { permanent_uuid: "0b7fca79063e4a45af1d9256ac095258" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37225 } }
I20260812 06:14:03.041112 19198 ts_tablet_manager.cc:1428] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:14:03.041152 18663 heartbeater.cc:503] Master 127.0.176.254:44723 was elected leader, sending a full tablet report...
I20260812 06:14:03.041133 19205 raft_consensus.cc:348] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "424d9538a6f44614ad8e2c56ff92d973" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41003 } } peers { permanent_uuid: "504b7140adbc46cbbd2e249d4dd6de19" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38953 } } peers { permanent_uuid: "0b7fca79063e4a45af1d9256ac095258" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37225 } }
I20260812 06:14:03.041338 19205 raft_consensus.cc:374] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:14:03.041396 19205 raft_consensus.cc:729] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b7fca79063e4a45af1d9256ac095258, State: Initialized, Role: FOLLOWER
I20260812 06:14:03.041529 19205 consensus_queue.cc:260] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "424d9538a6f44614ad8e2c56ff92d973" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41003 } } peers { permanent_uuid: "504b7140adbc46cbbd2e249d4dd6de19" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38953 } } peers { permanent_uuid: "0b7fca79063e4a45af1d9256ac095258" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37225 } }
I20260812 06:14:03.041884 19169 heartbeater.cc:503] Master 127.0.176.254:44723 was elected leader, sending a full tablet report...
I20260812 06:14:03.041870 19205 ts_tablet_manager.cc:1428] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:14:03.043133 19206 raft_consensus.cc:482] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:14:03.043243 19206 raft_consensus.cc:504] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "424d9538a6f44614ad8e2c56ff92d973" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41003 } } peers { permanent_uuid: "504b7140adbc46cbbd2e249d4dd6de19" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38953 } } peers { permanent_uuid: "0b7fca79063e4a45af1d9256ac095258" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37225 } }
I20260812 06:14:03.043638 19206 leader_election.cc:288] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 504b7140adbc46cbbd2e249d4dd6de19 (127.0.176.193:38953), 0b7fca79063e4a45af1d9256ac095258 (127.0.176.195:37225)
I20260812 06:14:03.047577 19194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.043870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:58917 (local address 127.0.176.193:38953)
0812 06:14:03.043922 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:03.043924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:03.044048 (+ 124us) server_negotiation.cc:407] Connection header received
0812 06:14:03.044122 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:03.044123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:03.044131 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:03.044183 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:14:03.044292 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.044994 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.046563 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.047188 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.047289 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:03.047298 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:03.047471 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 06:14:03.047518 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:14:03.047633 18922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.043778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:37225 (local address 127.0.176.194:35575)
0812 06:14:03.043896 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:03.043908 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:03.043955 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:03.044092 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:03.044093 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:03.044095 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:14:03.044170 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:03.044172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.045089 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.045090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:03.046443 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:03.046447 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.047287 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.047288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:03.047380 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:03.047382 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:14:03.047465 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 06:14:03.047526 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":86}
I20260812 06:14:03.047640 19217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.043778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:38953 (local address 127.0.176.194:58917)
0812 06:14:03.043984 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:03.043994 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:03.044067 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:03.044181 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:03.044182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:03.044183 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:14:03.044242 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:03.044244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.045088 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.045090 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:03.046443 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:03.046447 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.047287 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.047288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:03.047374 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:03.047380 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:14:03.047465 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 06:14:03.047525 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":68,"thread_start_us":89,"threads_started":1}
I20260812 06:14:03.047891 19196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.043913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:35575 (local address 127.0.176.195:37225)
0812 06:14:03.043961 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:03.043963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:03.043988 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:14:03.044013 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:03.044014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:03.044024 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:03.044076 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:14:03.044242 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.044999 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.046562 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.047193 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.047280 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:03.047291 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:03.047752 (+ 461us) server_negotiation.cc:299] Negotiation successful
0812 06:14:03.047810 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:14:03.048048 18592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3bd1d1647ca4f2b9e39e2b65b5511b8" candidate_uuid: "424d9538a6f44614ad8e2c56ff92d973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504b7140adbc46cbbd2e249d4dd6de19" is_pre_election: true
I20260812 06:14:03.048231 18592 raft_consensus.cc:2454] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 424d9538a6f44614ad8e2c56ff92d973 in term 0.
I20260812 06:14:03.048461 19087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3bd1d1647ca4f2b9e39e2b65b5511b8" candidate_uuid: "424d9538a6f44614ad8e2c56ff92d973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b7fca79063e4a45af1d9256ac095258" is_pre_election: true
I20260812 06:14:03.048516 18696 leader_election.cc:302] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 424d9538a6f44614ad8e2c56ff92d973, 504b7140adbc46cbbd2e249d4dd6de19; no voters:
I20260812 06:14:03.048592 19087 raft_consensus.cc:2454] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 424d9538a6f44614ad8e2c56ff92d973 in term 0.
I20260812 06:14:03.048679 19206 raft_consensus.cc:2781] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:14:03.048743 19206 raft_consensus.cc:482] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:14:03.048768 19206 raft_consensus.cc:3037] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:14:03.049527 19206 raft_consensus.cc:504] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "424d9538a6f44614ad8e2c56ff92d973" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41003 } } peers { permanent_uuid: "504b7140adbc46cbbd2e249d4dd6de19" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38953 } } peers { permanent_uuid: "0b7fca79063e4a45af1d9256ac095258" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37225 } }
I20260812 06:14:03.049680 19206 leader_election.cc:288] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [CANDIDATE]: Term 1 election: Requested vote from peers 504b7140adbc46cbbd2e249d4dd6de19 (127.0.176.193:38953), 0b7fca79063e4a45af1d9256ac095258 (127.0.176.195:37225)
I20260812 06:14:03.049896 18592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3bd1d1647ca4f2b9e39e2b65b5511b8" candidate_uuid: "424d9538a6f44614ad8e2c56ff92d973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504b7140adbc46cbbd2e249d4dd6de19"
I20260812 06:14:03.049919 19087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3bd1d1647ca4f2b9e39e2b65b5511b8" candidate_uuid: "424d9538a6f44614ad8e2c56ff92d973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b7fca79063e4a45af1d9256ac095258"
I20260812 06:14:03.049979 18592 raft_consensus.cc:3037] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:14:03.049998 19087 raft_consensus.cc:3037] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:14:03.050710 19087 raft_consensus.cc:2454] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 424d9538a6f44614ad8e2c56ff92d973 in term 1.
I20260812 06:14:03.050909 18697 leader_election.cc:302] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b7fca79063e4a45af1d9256ac095258, 424d9538a6f44614ad8e2c56ff92d973; no voters:
I20260812 06:14:03.050938 18592 raft_consensus.cc:2454] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 424d9538a6f44614ad8e2c56ff92d973 in term 1.
I20260812 06:14:03.051000 19206 raft_consensus.cc:2781] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:14:03.051199 19206 raft_consensus.cc:686] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [term 1 LEADER]: Becoming Leader. State: Replica: 424d9538a6f44614ad8e2c56ff92d973, State: Running, Role: LEADER
I20260812 06:14:03.051322 19206 consensus_queue.cc:237] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "424d9538a6f44614ad8e2c56ff92d973" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41003 } } peers { permanent_uuid: "504b7140adbc46cbbd2e249d4dd6de19" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38953 } } peers { permanent_uuid: "0b7fca79063e4a45af1d9256ac095258" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37225 } }
I20260812 06:14:03.052263 18343 catalog_manager.cc:5495] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 reported cstate change: term changed from 0 to 1, leader changed from <none> to 424d9538a6f44614ad8e2c56ff92d973 (127.0.176.194). New cstate: current_term: 1 leader_uuid: "424d9538a6f44614ad8e2c56ff92d973" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "424d9538a6f44614ad8e2c56ff92d973" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "504b7140adbc46cbbd2e249d4dd6de19" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b7fca79063e4a45af1d9256ac095258" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37225 } health_report { overall_health: UNKNOWN } } }
I20260812 06:14:03.062424 19193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.060080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59978 (local address 127.0.176.194:41003)
0812 06:14:03.060143 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:03.060144 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:03.060153 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:14:03.060223 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:03.060223 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:03.060240 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:03.060301 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:14:03.060430 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.060889 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.061689 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:03.061870 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:03.061933 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:03.062103 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:14:03.062200 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:14:03.062260 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:03.062294 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 06:14:03.062313 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:14:03.064347 18592 raft_consensus.cc:1261] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 504b7140adbc46cbbd2e249d4dd6de19 [term 1 FOLLOWER]: Refusing update from remote peer 424d9538a6f44614ad8e2c56ff92d973: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:14:03.064347 19087 raft_consensus.cc:1261] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258 [term 1 FOLLOWER]: Refusing update from remote peer 424d9538a6f44614ad8e2c56ff92d973: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:14:03.064709 19206 consensus_queue.cc:1035] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "504b7140adbc46cbbd2e249d4dd6de19" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:14:03.064854 19218 consensus_queue.cc:1035] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b7fca79063e4a45af1d9256ac095258" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:14:03.068360 19226 mvcc.cc:205] Tried to move back new op lower bound from 7317566435588780032 to 7317566435539046400. Current Snapshot: MvccSnapshot[applied={T|T < 7317566435588780032}]
I20260812 06:14:03.070501 18343 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:14:03.070613 18343 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:14:03.071798 18343 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 759c29acf784447e8421371a42881d6c: Sending DeleteTablet for 3 replicas of tablet c3bd1d1647ca4f2b9e39e2b65b5511b8
I20260812 06:14:03.072145 18793 tablet_service.cc:1514] Processing DeleteTablet for tablet c3bd1d1647ca4f2b9e39e2b65b5511b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:14:03 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:59970
I20260812 06:14:03.072184 18563 tablet_service.cc:1514] Processing DeleteTablet for tablet c3bd1d1647ca4f2b9e39e2b65b5511b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:14:03 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:38324
I20260812 06:14:03.072261 19041 tablet_service.cc:1514] Processing DeleteTablet for tablet c3bd1d1647ca4f2b9e39e2b65b5511b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:14:03 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:48208
I20260812 06:14:03.072578 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 18455
I20260812 06:14:03.093811 19251 tablet_replica.cc:330] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258: stopping tablet replica
I20260812 06:14:03.094029 19251 raft_consensus.cc:2229] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:14:03.094168 19251 raft_consensus.cc:2258] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:14:03.112350 19251 ts_tablet_manager.cc:1905] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:14:03.114378 19251 ts_tablet_manager.cc:1918] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:14:03.114500 19251 log.cc:1196] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/c3bd1d1647ca4f2b9e39e2b65b5511b8
I20260812 06:14:03.114861 19251 ts_tablet_manager.cc:1939] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 0b7fca79063e4a45af1d9256ac095258: Deleting consensus metadata
I20260812 06:14:03.115490 19243 tablet_replica.cc:330] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973: stopping tablet replica
I20260812 06:14:03.115509 18313 catalog_manager.cc:4841] TS 0b7fca79063e4a45af1d9256ac095258 (127.0.176.195:37225): tablet c3bd1d1647ca4f2b9e39e2b65b5511b8 (table test-table [id=c05837306c964ec4baf001b176bc601a]) successfully deleted
I20260812 06:14:03.115640 19243 raft_consensus.cc:2229] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:14:03.115803 19243 raft_consensus.cc:2258] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:14:03.116470 19243 ts_tablet_manager.cc:1905] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 06:14:03.118266 18309 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:38953 (error 108)
I20260812 06:14:03.118335 19243 ts_tablet_manager.cc:1918] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:14:03.118431 19243 log.cc:1196] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/c3bd1d1647ca4f2b9e39e2b65b5511b8
I20260812 06:14:03.118783 19243 ts_tablet_manager.cc:1939] T c3bd1d1647ca4f2b9e39e2b65b5511b8 P 424d9538a6f44614ad8e2c56ff92d973: Deleting consensus metadata
I20260812 06:14:03.119012 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 18668
I20260812 06:14:03.119787 19190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.119143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:38953 (local address 127.0.0.1:38338)
0812 06:14:03.119699 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:03.119741 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:38953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":531}
W20260812 06:14:03.119979 18309 catalog_manager.cc:4584] TS 504b7140adbc46cbbd2e249d4dd6de19 (127.0.176.193:38953): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c3bd1d1647ca4f2b9e39e2b65b5511b8: Network error: Client connection negotiation failed: client connection to 127.0.176.193:38953: connect: Connection refused (error 111)
I20260812 06:14:03.132066 19190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:03.131907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:41003 (local address 127.0.0.1:59990)
0812 06:14:03.131979 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:03.132023 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.194:41003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 06:14:03.132043 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 18927
I20260812 06:14:03.146785 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 18276
2026-08-12T06:14:03Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2286 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:14:03 dist-test-slave-gw5c krb5kdc[19265](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:14:03 dist-test-slave-gw5c krb5kdc[19265](info): set up 2 sockets
Aug 12 06:14:03 dist-test-slave-gw5c krb5kdc[19265](info): commencing operation
krb5kdc: starting...
W20260812 06:14:04.470229 707 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:14:04 dist-test-slave-gw5c krb5kdc[19265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:14:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:14:04Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.0.176.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.0.176.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/rangeradmin_127.0.176.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/rangeradmin_127.0.176.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.0.176.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.0.176.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/rangerlookup_127.0.176.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/rangerlookup_127.0.176.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.0.176.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.0.176.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/HTTP_127.0.176.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/HTTP_127.0.176.212@KRBTEST.COM.keytab.
I20260812 06:14:04.652420 707 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskuoICiU/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/postgres -l logfile start
2026-08-12 06:14:07.172 UTC [19313] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 06:14:07.172 UTC [19313] LOG: listening on IPv4 address "127.0.176.212", port 35465
2026-08-12 06:14:07.176 UTC [19313] LOG: listening on Unix socket "/tmp/.s.PGSQL.35465"
2026-08-12 06:14:07.199 UTC [19321] LOG: database system was shut down at 2026-08-12 06:14:05 UTC
2026-08-12 06:14:07.203 UTC [19313] LOG: database system is ready to accept connections
I20260812 06:14:08.435986 707 mini_postgres.cc:96] Postgres bound to 35465
2026-08-12 06:14:08.445 UTC [19338] FATAL: database "slave" does not exist
127.0.176.212:35465 - accepting connections
I20260812 06:14:08.447696 707 mini_ranger.cc:161] Starting Ranger...
I20260812 06:14:08.468828 707 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 06:14:08.962428 707 mini_ranger.cc:87] Created ranger Postgres database
I20260812 06:14:08.962505 707 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-admin
2026-08-12 06:14:09,342 [I] DB FLAVOR :POSTGRES
2026-08-12 06:14:09,342 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:14:09,342 [I] Checking connection..
2026-08-12 06:14:09,342 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 06:14:09,646 [I] Checking connection passed.
2026-08-12 06:14:09,647 [I] --------- Verifying version history table ---------
2026-08-12 06:14:09,647 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:14:09,912 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:14:09,912 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:14:10,182 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:14:10,182 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 06:14:10,182 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 06:14:10.492 UTC [19463] WARNING: there is no transaction in progress
2026-08-12 06:14:10,502 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 06:14:10,503 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:14:10,766 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 06:14:10,767 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:14:10,767 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 06:14:11,034 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 06:14:11,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gw5c.c.gcp-upstream.internal','N') ;"
2026-08-12 06:14:11,561 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:14:11,846 [I] Table x_portal_user does not exist in database ranger
2026-08-12 06:14:11,846 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:14:12,136 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 06:14:12,137 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:14:12,415 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:14:12,687 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 06:14:12,687 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 06:14:13.792 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:13.810 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:13.828 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:13.845 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:13.865 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:13.887 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:13.948 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:13.956 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:13.971 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:13.982 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:13.994 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:14.009 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:14.020 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:14.027 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:14.033 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:14.040 UTC [19654] WARNING: there is no transaction in progress
2026-08-12 06:14:14,762 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 06:14:14,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 06:14:15,025 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 06:14:15,025 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:14:15,283 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 06:14:15,283 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:14:15,559 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 06:14:15,560 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:14:15,850 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:14:16,123 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gw5c.c.gcp-upstream.internal';"
2026-08-12 06:14:16,399 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 06:14:16,400 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 06:14:16,685 [I] DB_PATCHES have already been applied
I20260812 06:14:16.692463 707 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-admin:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskuoICiU/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 06:14:16.692545 707 mini_ranger.cc:193] Using host: 127.0.176.212
I20260812 06:14:16.696976 707 mini_ranger.cc:227] Ranger admin URL: http://127.0.176.212:49529
Aug 12, 2026 6:14:17 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:14:17 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:14:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 6:14:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 6:14:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 6:14:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 6:14:17 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 06:14:18.123502 707 mini_ranger.cc:160] Time spent starting Ranger: real 9.676s user 0.000s sys 0.013s
Aug 12, 2026 6:14:40 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 6:14:40 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 6:14:40 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 6:14:40 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 6:14:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 6:14:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 6:14:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 6:14:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 6:14:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 6:14:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 6:14:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 6:14:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 6:14:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 6:14:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 6:14:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 6:14:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 6:14:40 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 6:14:41 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 06:14:42.006636 707 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.0.176.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.0.176.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/rangerkms_127.0.176.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/rangerkms_127.0.176.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.0.176.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.0.176.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.0.176.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/HTTP_127.0.176.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.0.176.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/HTTP_127.0.176.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 06:14:42 dist-test-slave-gw5c krb5kdc[19265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515282, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 06:14:42.100112 707 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 06:14:42.111269 707 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 06:14:42.925995 707 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 06:14:42.926097 707 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-kms
I20260812 06:14:42.926122 707 mini_ranger_kms.cc:227] Using postgres at 127.0.176.212:35465
2026-08-12 06:14:43,281 [I] DB FLAVOR :POSTGRES
2026-08-12 06:14:43,282 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:14:43,282 [I] Checking connection
2026-08-12 06:14:43,282 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 06:14:43,596 [I] connection success
2026-08-12 06:14:43,597 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 06:14:43,597 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 06:14:43,597 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 06:14:43,891 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 06:14:43,891 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:14:43,891 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 06:14:43,891 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:35465/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 06:14:44,199 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 06:14:44.716584 707 mini_ranger_kms.cc:310] Created kms service
I20260812 06:14:44.946164 707 mini_ranger_kms.cc:326] Created kudu user
I20260812 06:14:44.993799 707 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 06:14:44 dist-test-slave-gw5c krb5kdc[19265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515282, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:14:45.428047 707 mini_ranger_kms.cc:384] Added ranger policy
I20260812 06:14:45.428186 707 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-kms:/tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 06:14:45.428211 707 mini_ranger_kms.cc:240] Using host: 127.0.176.212
I20260812 06:14:45.432387 707 mini_ranger_kms.cc:276] Ranger KMS PID: 19971
I20260812 06:14:45.432530 707 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.0.176.212:58651
Aug 12, 2026 6:14:46 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:14:46 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:14:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 6:14:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 6:14:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 6:14:46 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 06:14:47 dist-test-slave-gw5c krb5kdc[19265](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515287, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.176.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:14:48.282833 707 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.183s user 0.010s sys 0.301s
I20260812 06:14:48.282948 707 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 06:14:48.283025 707 mini_ranger_kms.cc:401] 127.0.176.212:58651/kms/v1/keys
Aug 12 06:14:48 dist-test-slave-gw5c krb5kdc[19265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515287, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.176.212@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
Aug 12 06:14:48 dist-test-slave-gw5c krb5kdc[19265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515287, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.176.212@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
Aug 12 06:14:51 dist-test-slave-gw5c krb5kdc[19265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:14:51.352530 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:37683
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:37683
--ranger_config_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.176.212:58651/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:14:51.445545 20056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:51.445825 20056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:51.445868 20056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:51.447657 20056 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:14:51.447747 20056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:51.447772 20056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:51.447809 20056 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:14:51.447844 20056 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:14:51.450559 20056 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/wal
--ranger_kms_url=127.0.176.212:58651/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:37683
--ranger_config_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:37683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:51.450958 20056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:51.451246 20056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:51.456830 20063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:51.457116 20056 server_base.cc:1034] running on GCE node
W20260812 06:14:51.456862 20068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:51.456848 20066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:51.457527 20056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:51.457890 20056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:51.459059 20056 hybrid_clock.cc:648] HybridClock initialized: now 1786515291459028 us; error 45 us; skew 500 ppm
Aug 12 06:14:51 dist-test-slave-gw5c krb5kdc[19265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515291, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:14:51.462844 20056 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:14:51.463441 20056 webserver.cc:460] Webserver started at http://127.0.176.254:33433/ using document root <none> and password file <none>
I20260812 06:14:51.463725 20056 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:51.463783 20056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:51.463915 20056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:14:51 dist-test-slave-gw5c krb5kdc[19265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515291, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:14:51.521507 20056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "d6c6acb9a94f41eb9abee2fca2586aff"
format_stamp: "Formatted at 2026-08-12 06:14:51 on dist-test-slave-gw5c"
server_key: "f2118c4d420a27873d68532be84e890c"
server_key_iv: "a2f81be125aba8e58052a55500f981c9"
server_key_version: "kuduclusterkey@0"
I20260812 06:14:51.521944 20056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "d6c6acb9a94f41eb9abee2fca2586aff"
format_stamp: "Formatted at 2026-08-12 06:14:51 on dist-test-slave-gw5c"
server_key: "f2118c4d420a27873d68532be84e890c"
server_key_iv: "a2f81be125aba8e58052a55500f981c9"
server_key_version: "kuduclusterkey@0"
I20260812 06:14:51.523502 20056 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:14:51.539953 20079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:51.540223 20056 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:14:51.540347 20056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "d6c6acb9a94f41eb9abee2fca2586aff"
format_stamp: "Formatted at 2026-08-12 06:14:51 on dist-test-slave-gw5c"
server_key: "f2118c4d420a27873d68532be84e890c"
server_key_iv: "a2f81be125aba8e58052a55500f981c9"
server_key_version: "kuduclusterkey@0"
I20260812 06:14:51.540474 20056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:14:51.557694 20056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:51.560043 20056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:51.560242 20056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:51.565572 20056 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:37683
I20260812 06:14:51.565604 20161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:37683 every 8 connection(s)
I20260812 06:14:51.565981 20056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:14:51.566753 20162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:14:51.569288 20162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff: Bootstrap starting.
I20260812 06:14:51.570089 20162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff: Neither blocks nor log segments found. Creating new log.
I20260812 06:14:51.570516 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 20056
I20260812 06:14:51.570519 20162 log.cc:824] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff: Log is configured to *not* fsync() on all Append() calls
I20260812 06:14:51.570647 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:14:51.570855 707 external_mini_cluster.cc:1428] Setting key d83ba66768200dad17427901c264a326
I20260812 06:14:51.571527 20162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff: No bootstrap required, opened a new log
I20260812 06:14:51.573709 20162 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6c6acb9a94f41eb9abee2fca2586aff" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37683 } }
I20260812 06:14:51.573908 20162 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:14:51.573989 20162 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6c6acb9a94f41eb9abee2fca2586aff, State: Initialized, Role: FOLLOWER
I20260812 06:14:51.574150 20162 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6c6acb9a94f41eb9abee2fca2586aff" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37683 } }
I20260812 06:14:51.574239 20162 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:14:51.574271 20162 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:14:51.574345 20162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:14:51.575269 20162 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6c6acb9a94f41eb9abee2fca2586aff" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37683 } }
I20260812 06:14:51.575430 20162 leader_election.cc:302] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6c6acb9a94f41eb9abee2fca2586aff; no voters:
I20260812 06:14:51.575614 20162 leader_election.cc:288] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:14:51.575676 20179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:14:51.575891 20179 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [term 1 LEADER]: Becoming Leader. State: Replica: d6c6acb9a94f41eb9abee2fca2586aff, State: Running, Role: LEADER
I20260812 06:14:51.575984 20162 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:14:51.576027 20179 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6c6acb9a94f41eb9abee2fca2586aff" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37683 } }
I20260812 06:14:51.576375 20179 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6c6acb9a94f41eb9abee2fca2586aff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6c6acb9a94f41eb9abee2fca2586aff" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37683 } } }
I20260812 06:14:51.576443 20179 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [sys.catalog]: This master's current role is: LEADER
I20260812 06:14:51.576551 20179 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6c6acb9a94f41eb9abee2fca2586aff. Latest consensus state: current_term: 1 leader_uuid: "d6c6acb9a94f41eb9abee2fca2586aff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6c6acb9a94f41eb9abee2fca2586aff" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37683 } } }
I20260812 06:14:51.576598 20179 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff [sys.catalog]: This master's current role is: LEADER
I20260812 06:14:51.576802 20185 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:14:51.577281 20185 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:14:51.579231 20162 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 12 06:14:51 dist-test-slave-gw5c krb5kdc[19265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:14:51.589483 20185 catalog_manager.cc:1347] Generated new cluster ID: 8b62717d54f64685979065345b653838
I20260812 06:14:51.589654 20185 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:14:51.591373 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:51.571450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59992 (local address 127.0.176.254:37683)
0812 06:14:51.574031 (+ 2581us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:51.574043 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:51.574078 (+ 35us) server_negotiation.cc:407] Connection header received
0812 06:14:51.574197 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:51.574204 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:51.574266 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:51.575271 (+ 1005us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:51.575386 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:51.577522 (+ 2136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:51.578794 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:51.579443 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:51.579555 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:51.582532 (+ 2977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:51.582536 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:51.582536 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:14:51.582548 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:51.587916 (+ 5368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:51.588476 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:51.588480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:51.588480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:51.589028 (+ 548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:51.589310 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:51.589314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:51.589315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:51.589899 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:51.590615 (+ 716us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:51.590697 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 06:14:51.591069 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2525,"thread_start_us":75,"threads_started":1}
I20260812 06:14:51.610069 20185 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:14:51.610953 20185 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:14:51.614637 20185 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff: Generated new TSK 0
I20260812 06:14:51.614907 20185 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:14:52.446516 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.176.212:58651/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37683
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:14:52.549141 20244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:52.549422 20244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:52.549466 20244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:52.550900 20244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:52.550982 20244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:52.551034 20244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:14:52.552997 20244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.0.176.212:58651/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:52.553318 20244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:52.553596 20244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:52.558986 20252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:52.558954 20251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:52.558986 20254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:52.559191 20244 server_base.cc:1034] running on GCE node
I20260812 06:14:52.559531 20244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:52.559827 20244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:52.561014 20244 hybrid_clock.cc:648] HybridClock initialized: now 1786515292560992 us; error 37 us; skew 500 ppm
Aug 12 06:14:52 dist-test-slave-gw5c krb5kdc[19265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515292, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:14:52.564080 20244 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:14:52.564671 20244 webserver.cc:460] Webserver started at http://127.0.176.193:46317/ using document root <none> and password file <none>
I20260812 06:14:52.564942 20244 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:52.564992 20244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:52.565150 20244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:14:52 dist-test-slave-gw5c krb5kdc[19265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515292, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:14:52.585532 20244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "99754bf6e821499fbd7bdd1d10affdb1"
format_stamp: "Formatted at 2026-08-12 06:14:52 on dist-test-slave-gw5c"
server_key: "7053b6253b02da313c3ad5d3091f3397"
server_key_iv: "eabed72e13f509c506cae2c3aae7b59a"
server_key_version: "kuduclusterkey@0"
I20260812 06:14:52.586151 20244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "99754bf6e821499fbd7bdd1d10affdb1"
format_stamp: "Formatted at 2026-08-12 06:14:52 on dist-test-slave-gw5c"
server_key: "7053b6253b02da313c3ad5d3091f3397"
server_key_iv: "eabed72e13f509c506cae2c3aae7b59a"
server_key_version: "kuduclusterkey@0"
I20260812 06:14:52.593364 20244 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.000s
I20260812 06:14:52.612875 20266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:52.613199 20244 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:14:52.613364 20244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "99754bf6e821499fbd7bdd1d10affdb1"
format_stamp: "Formatted at 2026-08-12 06:14:52 on dist-test-slave-gw5c"
server_key: "7053b6253b02da313c3ad5d3091f3397"
server_key_iv: "eabed72e13f509c506cae2c3aae7b59a"
server_key_version: "kuduclusterkey@0"
I20260812 06:14:52.613538 20244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:14:52.629117 20244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:52.631971 20244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:52.632229 20244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:52.632570 20244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:14:52.633028 20244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:14:52.633117 20244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:52.633219 20244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:14:52.633297 20244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:52.641063 20244 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:44659
I20260812 06:14:52.641613 20244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:14:52.641758 20475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:44659 every 8 connection(s)
I20260812 06:14:52.647912 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 20244
I20260812 06:14:52.648046 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:14:52.648258 707 external_mini_cluster.cc:1428] Setting key 5a799c0f1128f01b1610fff9233519bd
Aug 12 06:14:52 dist-test-slave-gw5c krb5kdc[19265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515292, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:14:52.656546 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:52.642736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:37683 (local address 127.0.176.193:57677)
0812 06:14:52.643259 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:52.643319 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:52.644106 (+ 787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:52.644571 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:52.644575 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:52.644851 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:14:52.645152 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:52.645159 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:52.646233 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:52.646234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:52.647595 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:52.647599 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:52.649406 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:52.649408 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:52.649576 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:52.650298 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:14:52.650310 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:14:52.652240 (+ 1930us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:14:52.654439 (+ 2199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:14:52.654450 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:14:52.654453 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:14:52.654797 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:14:52.655184 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:14:52.655185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:14:52.655186 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:14:52.655364 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:14:52.655753 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:14:52.655761 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:14:52.655948 (+ 187us) client_negotiation.cc:769] Sending connection context
0812 06:14:52.656046 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 06:14:52.656234 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":99,"threads_started":1}
I20260812 06:14:52.657447 20487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:52.643104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:57677 (local address 127.0.176.254:37683)
0812 06:14:52.644330 (+ 1226us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:52.644332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:52.644341 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:14:52.644372 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:52.644373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:52.644386 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:52.645257 (+ 871us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:52.645321 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:52.646113 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:52.648962 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:52.649292 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:52.649854 (+ 562us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:52.652370 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:52.652372 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:52.652372 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:14:52.652381 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:52.654323 (+ 1942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:52.654915 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:52.654916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:52.654917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:52.654990 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:52.655507 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:52.655508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:52.655508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:52.655670 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:52.657181 (+ 1511us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:52.657234 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 06:14:52.657341 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1200,"thread_start_us":70,"threads_started":1}
I20260812 06:14:52.658078 20477 heartbeater.cc:347] Connected to a master server at 127.0.176.254:37683
I20260812 06:14:52.658190 20477 heartbeater.cc:464] Registering TS with master...
I20260812 06:14:52.658425 20477 heartbeater.cc:511] Master 127.0.176.254:37683 requested a full tablet report, sending...
I20260812 06:14:52.659086 20108 ts_manager.cc:194] Registered new tserver with Master: 99754bf6e821499fbd7bdd1d10affdb1 (127.0.176.193:44659)
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
I20260812 06:14:52.660145 20108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:57677
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:14:52.684134 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.176.212:58651/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37683
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:14:52.811870 20490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:52.812288 20490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:52.812410 20490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:52.814538 20490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:52.814702 20490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:52.814800 20490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:14:52.817433 20490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.0.176.212:58651/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:52.818061 20490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:52.818409 20490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:52.825927 20505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:52.826301 20503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:52.827167 20507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:52.827502 20490 server_base.cc:1034] running on GCE node
I20260812 06:14:52.827913 20490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:52.828233 20490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:52.829422 20490 hybrid_clock.cc:648] HybridClock initialized: now 1786515292829401 us; error 36 us; skew 500 ppm
Aug 12 06:14:52 dist-test-slave-gw5c krb5kdc[19265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515292, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:14:52.833299 20490 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:14:52.833901 20490 webserver.cc:460] Webserver started at http://127.0.176.194:35069/ using document root <none> and password file <none>
I20260812 06:14:52.834196 20490 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:52.834262 20490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:52.834427 20490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:14:52 dist-test-slave-gw5c krb5kdc[19265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515292, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:14:52.859432 20490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "5fb2e7f978e8403b82823e145a98021b"
format_stamp: "Formatted at 2026-08-12 06:14:52 on dist-test-slave-gw5c"
server_key: "50d5fb28051e4461f9539404d69a89a8"
server_key_iv: "5b80b83ed3ae503e76c33395dc6c9c85"
server_key_version: "kuduclusterkey@0"
I20260812 06:14:52.860127 20490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "5fb2e7f978e8403b82823e145a98021b"
format_stamp: "Formatted at 2026-08-12 06:14:52 on dist-test-slave-gw5c"
server_key: "50d5fb28051e4461f9539404d69a89a8"
server_key_iv: "5b80b83ed3ae503e76c33395dc6c9c85"
server_key_version: "kuduclusterkey@0"
I20260812 06:14:52.864917 20490 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.001s
I20260812 06:14:52.892987 20518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:52.893292 20490 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 06:14:52.893424 20490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "5fb2e7f978e8403b82823e145a98021b"
format_stamp: "Formatted at 2026-08-12 06:14:52 on dist-test-slave-gw5c"
server_key: "50d5fb28051e4461f9539404d69a89a8"
server_key_iv: "5b80b83ed3ae503e76c33395dc6c9c85"
server_key_version: "kuduclusterkey@0"
I20260812 06:14:52.893548 20490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 12 06:14:52 dist-test-slave-gw5c krb5kdc[19265](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515292, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:14:52.914896 20490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:52.917953 20490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:52.918210 20490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:52.918525 20490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:14:52.918934 20490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:14:52.919005 20490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:52.919046 20490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:14:52.919072 20490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:52.930641 20490 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:39397
I20260812 06:14:52.931177 20490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:14:52.932929 20715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:39397 every 8 connection(s)
I20260812 06:14:52.933327 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 20490
I20260812 06:14:52.933444 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:14:52.933650 707 external_mini_cluster.cc:1428] Setting key 7affd1022f346e4bd379be2efcb0a382
Aug 12 06:14:52 dist-test-slave-gw5c krb5kdc[19265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515292, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:14:52.945923 20487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:52.932590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:54065 (local address 127.0.176.254:37683)
0812 06:14:52.932642 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:52.932645 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:52.933490 (+ 845us) server_negotiation.cc:407] Connection header received
0812 06:14:52.934750 (+ 1260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:52.934752 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:52.934769 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:52.934800 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:52.935765 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:52.936574 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:52.938134 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:52.938487 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:52.938541 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:52.942013 (+ 3472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:52.942015 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:52.942016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:14:52.942026 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:52.944027 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:52.944679 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:52.944680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:52.944680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:52.944749 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:52.945084 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:52.945086 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:52.945086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:52.945243 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:52.945290 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:52.945691 (+ 401us) server_negotiation.cc:299] Negotiation successful
0812 06:14:52.945801 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:14:52.946672 20723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:52.932233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:37683 (local address 127.0.176.194:54065)
0812 06:14:52.933311 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:52.933362 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:52.934585 (+ 1223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:52.935002 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:52.935007 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:52.935302 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:14:52.935641 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:52.935648 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:52.936710 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:52.936712 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:52.938009 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:52.938012 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:52.938658 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:52.938659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:52.938831 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:52.939666 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:14:52.939679 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:14:52.941855 (+ 2176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:14:52.944148 (+ 2293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:14:52.944158 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:14:52.944162 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:14:52.944582 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:14:52.944818 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:14:52.944819 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:14:52.944819 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:14:52.944998 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:14:52.945338 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:14:52.945344 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:14:52.945531 (+ 187us) client_negotiation.cc:769] Sending connection context
0812 06:14:52.946222 (+ 691us) client_negotiation.cc:240] Negotiation successful
0812 06:14:52.946421 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1028,"thread_start_us":102,"threads_started":1}
I20260812 06:14:52.947326 20716 heartbeater.cc:347] Connected to a master server at 127.0.176.254:37683
I20260812 06:14:52.947691 20716 heartbeater.cc:464] Registering TS with master...
I20260812 06:14:52.947969 20716 heartbeater.cc:511] Master 127.0.176.254:37683 requested a full tablet report, sending...
I20260812 06:14:52.948396 20108 ts_manager.cc:194] Registered new tserver with Master: 5fb2e7f978e8403b82823e145a98021b (127.0.176.194:39397)
I20260812 06:14:52.948953 20108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:54065
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:14:52.981954 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.176.212:58651/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37683
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:14:53.110728 20726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:14:53.111069 20726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:14:53.111109 20726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:14:53.113305 20726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:14:53.113402 20726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:14:53.113459 20726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:14:53.116080 20726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.0.176.212:58651/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:14:53.116393 20726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:14:53.116686 20726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:14:53.123838 20737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:14:53.124343 20740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:53.125418 20726 server_base.cc:1034] running on GCE node
W20260812 06:14:53.127599 20736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:14:53.127918 20726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:14:53.128247 20726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:14:53.132887 20726 hybrid_clock.cc:648] HybridClock initialized: now 1786515293132851 us; error 44 us; skew 500 ppm
Aug 12 06:14:53 dist-test-slave-gw5c krb5kdc[19265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515293, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:14:53.136647 20726 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:14:53.137472 20726 webserver.cc:460] Webserver started at http://127.0.176.195:39061/ using document root <none> and password file <none>
I20260812 06:14:53.137775 20726 fs_manager.cc:359] Metadata directory not provided
I20260812 06:14:53.137850 20726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:14:53.137995 20726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:14:53 dist-test-slave-gw5c krb5kdc[19265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515293, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:14:53.159050 20726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "08d8ba201a6d4df5920b5f4f2a77368e"
format_stamp: "Formatted at 2026-08-12 06:14:53 on dist-test-slave-gw5c"
server_key: "b776fe4ab3a6c558e97f835f51f78526"
server_key_iv: "38970e60aee5c7339f49db0fea360007"
server_key_version: "kuduclusterkey@0"
I20260812 06:14:53.159731 20726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "08d8ba201a6d4df5920b5f4f2a77368e"
format_stamp: "Formatted at 2026-08-12 06:14:53 on dist-test-slave-gw5c"
server_key: "b776fe4ab3a6c558e97f835f51f78526"
server_key_iv: "38970e60aee5c7339f49db0fea360007"
server_key_version: "kuduclusterkey@0"
I20260812 06:14:53.163004 20726 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260812 06:14:53.181990 20758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:53.182253 20726 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:14:53.182343 20726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "08d8ba201a6d4df5920b5f4f2a77368e"
format_stamp: "Formatted at 2026-08-12 06:14:53 on dist-test-slave-gw5c"
server_key: "b776fe4ab3a6c558e97f835f51f78526"
server_key_iv: "38970e60aee5c7339f49db0fea360007"
server_key_version: "kuduclusterkey@0"
I20260812 06:14:53.182451 20726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:14:53.206485 20726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:14:53.209177 20726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:14:53.209345 20726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:14:53.209618 20726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:14:53.210011 20726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:14:53.210069 20726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:53.210107 20726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:14:53.210126 20726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:14:53.218191 20726 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:42227
I20260812 06:14:53.218780 20726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:14:53.220532 20942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:42227 every 8 connection(s)
I20260812 06:14:53.225888 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 20726
I20260812 06:14:53.226061 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:14:53.226475 707 external_mini_cluster.cc:1428] Setting key 9d5cd460998cef72c355a9757bddaf0c
Aug 12 06:14:53 dist-test-slave-gw5c krb5kdc[19265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515293, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:14:53.235056 20487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.221972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:44777 (local address 127.0.176.254:37683)
0812 06:14:53.222027 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:53.222029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:53.222465 (+ 436us) server_negotiation.cc:407] Connection header received
0812 06:14:53.223461 (+ 996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:53.223464 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:53.223481 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:53.223516 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:53.224700 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.225472 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.228026 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.228350 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.228396 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.231366 (+ 2970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:53.231368 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:53.231368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:14:53.231378 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:53.233240 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:53.233825 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:53.233827 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:53.233827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:53.233895 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:53.234220 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:53.234221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:53.234221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:53.234376 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:53.234421 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:53.234823 (+ 402us) server_negotiation.cc:299] Negotiation successful
0812 06:14:53.234947 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:14:53.235859 20947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.221844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:37683 (local address 127.0.176.195:44777)
0812 06:14:53.222314 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:53.222362 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:53.223249 (+ 887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:53.223734 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:53.223739 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:53.224177 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:14:53.224575 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:53.224583 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.225610 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.225611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:53.227905 (+ 2294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:53.227910 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.228509 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.228510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:53.228670 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.229426 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:14:53.229438 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:14:53.231220 (+ 1782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:14:53.233357 (+ 2137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:14:53.233370 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:14:53.233373 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:14:53.233719 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:14:53.233988 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:14:53.233989 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:14:53.233990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:14:53.234138 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:14:53.234470 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:14:53.234477 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:14:53.234660 (+ 183us) client_negotiation.cc:769] Sending connection context
0812 06:14:53.235236 (+ 576us) client_negotiation.cc:240] Negotiation successful
0812 06:14:53.235578 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":125,"threads_started":1}
I20260812 06:14:53.236593 20944 heartbeater.cc:347] Connected to a master server at 127.0.176.254:37683
I20260812 06:14:53.236717 20944 heartbeater.cc:464] Registering TS with master...
I20260812 06:14:53.236961 20944 heartbeater.cc:511] Master 127.0.176.254:37683 requested a full tablet report, sending...
I20260812 06:14:53.237354 20108 ts_manager.cc:194] Registered new tserver with Master: 08d8ba201a6d4df5920b5f4f2a77368e (127.0.176.195:42227)
I20260812 06:14:53.237920 20108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:44777
I20260812 06:14:53.238755 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:14:53.249424 20487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.240650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60006 (local address 127.0.176.254:37683)
0812 06:14:53.240734 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:53.240737 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:53.241013 (+ 276us) server_negotiation.cc:407] Connection header received
0812 06:14:53.241135 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:53.241136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:53.241149 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:53.241193 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:14:53.242092 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.242873 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.244044 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.244379 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.244450 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.246152 (+ 1702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:14:53.246154 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:14:53.246154 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:14:53.246162 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:14:53.248015 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:53.248472 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:53.248473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:53.248473 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:53.248543 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:14:53.248787 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:14:53.248788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:14:53.248788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:14:53.248945 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:14:53.249054 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:53.249233 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 06:14:53.249323 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 06:14:53.251751 20108 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60006:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:14:53.254225 20108 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:14:53.264093 20975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.257321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:39397 (local address 127.0.0.1:56738)
0812 06:14:53.258530 (+ 1209us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:53.258576 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:53.258646 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:53.259822 (+ 1176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:53.259823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:53.259825 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:14:53.259863 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:53.259865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.261106 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.261107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:53.262394 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:53.262397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.263797 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.263798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:53.263885 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.263902 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 06:14:53.263951 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 06:14:53.264003 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1180,"thread_start_us":84,"threads_started":1}
I20260812 06:14:53.264881 20973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.257851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56738 (local address 127.0.176.194:39397)
0812 06:14:53.259650 (+ 1799us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:53.259656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:53.259666 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:14:53.259703 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:53.259705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:53.259721 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:53.259927 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:14:53.260007 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.261000 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.262856 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.263691 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.264586 (+ 895us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.264697 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:53.264728 (+ 31us) server_negotiation.cc:299] Negotiation successful
0812 06:14:53.264778 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1753,"thread_start_us":110,"threads_started":1}
I20260812 06:14:53.265756 20609 tablet_service.cc:1467] Processing CreateTablet for tablet 57b6e9ce9eee4f8a8aebb500c6ae4f56 (DEFAULT_TABLE table=test-table [id=b858ef2dfae341c881aa2086829c7e6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:14:53.266208 20609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b6e9ce9eee4f8a8aebb500c6ae4f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:14:53.266492 20969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.257595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44659 (local address 127.0.0.1:44438)
0812 06:14:53.258740 (+ 1145us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:53.258746 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:53.258774 (+ 28us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:53.259250 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:53.259253 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:53.259255 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:14:53.259319 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:53.259321 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.262697 (+ 3376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.262698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:53.264671 (+ 1973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:53.264674 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.266170 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.266171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:53.266238 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.266243 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:14:53.266361 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 06:14:53.266410 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1133,"thread_start_us":86,"threads_started":1}
I20260812 06:14:53.267091 20971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.257872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44438 (local address 127.0.176.193:44659)
0812 06:14:53.259021 (+ 1149us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:53.259026 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:53.259039 (+ 13us) server_negotiation.cc:407] Connection header received
0812 06:14:53.259073 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:53.259075 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:53.259090 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:53.259158 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:14:53.259480 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.262606 (+ 3126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.265240 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.266060 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.266859 (+ 799us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.266939 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:53.266969 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 06:14:53.267014 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1112,"thread_start_us":71,"threads_started":1}
I20260812 06:14:53.267902 20326 tablet_service.cc:1467] Processing CreateTablet for tablet 57b6e9ce9eee4f8a8aebb500c6ae4f56 (DEFAULT_TABLE table=test-table [id=b858ef2dfae341c881aa2086829c7e6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:14:53.268270 20326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b6e9ce9eee4f8a8aebb500c6ae4f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:14:53.271929 20970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.258104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:42227 (local address 127.0.0.1:34722)
0812 06:14:53.258823 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:53.258829 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:53.258896 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:53.259444 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:53.259445 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:53.259458 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:14:53.259494 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:53.259496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.262475 (+ 2979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.262476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:53.264204 (+ 1728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:53.264207 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.271652 (+ 7445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.271654 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:53.271733 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.271740 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 06:14:53.271776 (+ 36us) client_negotiation.cc:240] Negotiation successful
0812 06:14:53.271834 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"mutex_wait_us":654,"thread_start_us":74,"threads_started":1}
I20260812 06:14:53.272423 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.258238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34722 (local address 127.0.176.195:42227)
0812 06:14:53.258452 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:53.258459 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:53.258902 (+ 443us) server_negotiation.cc:407] Connection header received
0812 06:14:53.258990 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:53.258993 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:53.259011 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:53.259088 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:14:53.260632 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.261686 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.265109 (+ 3423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.271516 (+ 6407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.272153 (+ 637us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.272256 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:53.272292 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 06:14:53.272341 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":77,"threads_started":1}
I20260812 06:14:53.272408 20978 tablet_bootstrap.cc:492] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b: Bootstrap starting.
I20260812 06:14:53.273140 20832 tablet_service.cc:1467] Processing CreateTablet for tablet 57b6e9ce9eee4f8a8aebb500c6ae4f56 (DEFAULT_TABLE table=test-table [id=b858ef2dfae341c881aa2086829c7e6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:14:53.273561 20832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b6e9ce9eee4f8a8aebb500c6ae4f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:14:53.273536 20979 tablet_bootstrap.cc:492] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1: Bootstrap starting.
I20260812 06:14:53.274096 20978 tablet_bootstrap.cc:654] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b: Neither blocks nor log segments found. Creating new log.
I20260812 06:14:53.274883 20979 tablet_bootstrap.cc:654] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1: Neither blocks nor log segments found. Creating new log.
I20260812 06:14:53.275324 20978 log.cc:824] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:14:53.275799 20979 log.cc:824] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:14:53.276969 20978 tablet_bootstrap.cc:492] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b: No bootstrap required, opened a new log
I20260812 06:14:53.277050 20978 ts_tablet_manager.cc:1397] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 06:14:53.278337 20983 tablet_bootstrap.cc:492] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e: Bootstrap starting.
I20260812 06:14:53.279531 20983 tablet_bootstrap.cc:654] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e: Neither blocks nor log segments found. Creating new log.
I20260812 06:14:53.279350 20978 raft_consensus.cc:348] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42227 } } peers { permanent_uuid: "5fb2e7f978e8403b82823e145a98021b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39397 } } peers { permanent_uuid: "99754bf6e821499fbd7bdd1d10affdb1" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44659 } }
I20260812 06:14:53.279883 20978 raft_consensus.cc:374] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:14:53.279987 20978 raft_consensus.cc:729] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb2e7f978e8403b82823e145a98021b, State: Initialized, Role: FOLLOWER
I20260812 06:14:53.280216 20978 consensus_queue.cc:260] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42227 } } peers { permanent_uuid: "5fb2e7f978e8403b82823e145a98021b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39397 } } peers { permanent_uuid: "99754bf6e821499fbd7bdd1d10affdb1" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44659 } }
I20260812 06:14:53.280364 20983 log.cc:824] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:14:53.280689 20978 ts_tablet_manager.cc:1428] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 06:14:53.280715 20716 heartbeater.cc:503] Master 127.0.176.254:37683 was elected leader, sending a full tablet report...
I20260812 06:14:53.281590 20979 tablet_bootstrap.cc:492] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1: No bootstrap required, opened a new log
I20260812 06:14:53.281677 20979 ts_tablet_manager.cc:1397] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260812 06:14:53.282696 20983 tablet_bootstrap.cc:492] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e: No bootstrap required, opened a new log
I20260812 06:14:53.282761 20983 ts_tablet_manager.cc:1397] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260812 06:14:53.284557 20979 raft_consensus.cc:348] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42227 } } peers { permanent_uuid: "5fb2e7f978e8403b82823e145a98021b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39397 } } peers { permanent_uuid: "99754bf6e821499fbd7bdd1d10affdb1" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44659 } }
I20260812 06:14:53.284763 20979 raft_consensus.cc:374] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:14:53.284799 20979 raft_consensus.cc:729] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99754bf6e821499fbd7bdd1d10affdb1, State: Initialized, Role: FOLLOWER
I20260812 06:14:53.284865 20983 raft_consensus.cc:348] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42227 } } peers { permanent_uuid: "5fb2e7f978e8403b82823e145a98021b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39397 } } peers { permanent_uuid: "99754bf6e821499fbd7bdd1d10affdb1" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44659 } }
I20260812 06:14:53.284969 20979 consensus_queue.cc:260] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42227 } } peers { permanent_uuid: "5fb2e7f978e8403b82823e145a98021b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39397 } } peers { permanent_uuid: "99754bf6e821499fbd7bdd1d10affdb1" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44659 } }
I20260812 06:14:53.285049 20983 raft_consensus.cc:374] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:14:53.285086 20983 raft_consensus.cc:729] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08d8ba201a6d4df5920b5f4f2a77368e, State: Initialized, Role: FOLLOWER
I20260812 06:14:53.285197 20983 consensus_queue.cc:260] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42227 } } peers { permanent_uuid: "5fb2e7f978e8403b82823e145a98021b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39397 } } peers { permanent_uuid: "99754bf6e821499fbd7bdd1d10affdb1" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44659 } }
I20260812 06:14:53.285291 20979 ts_tablet_manager.cc:1428] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 06:14:53.285444 20983 ts_tablet_manager.cc:1428] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 06:14:53.285553 20944 heartbeater.cc:503] Master 127.0.176.254:37683 was elected leader, sending a full tablet report...
I20260812 06:14:53.285933 20477 heartbeater.cc:503] Master 127.0.176.254:37683 was elected leader, sending a full tablet report...
W20260812 06:14:53.393747 20483 tablet.cc:2369] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:14:53.433568 20722 tablet.cc:2369] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:14:53.472518 20945 tablet.cc:2369] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 06:14:53 dist-test-slave-gw5c krb5kdc[19265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515292, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:14:53.613673 20991 raft_consensus.cc:482] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:14:53.613837 20991 raft_consensus.cc:504] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42227 } } peers { permanent_uuid: "5fb2e7f978e8403b82823e145a98021b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39397 } } peers { permanent_uuid: "99754bf6e821499fbd7bdd1d10affdb1" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44659 } }
I20260812 06:14:53.614284 20991 leader_election.cc:288] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb2e7f978e8403b82823e145a98021b (127.0.176.194:39397), 99754bf6e821499fbd7bdd1d10affdb1 (127.0.176.193:44659)
I20260812 06:14:53.618983 20947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.614614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:39397 (local address 127.0.176.195:34967)
0812 06:14:53.614681 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:53.614699 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:53.614774 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:53.615499 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:53.615501 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:53.615504 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:14:53.615589 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:53.615592 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.616561 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.616562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:53.617827 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:53.617830 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.618693 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.618694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:53.618773 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.618777 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:14:53.618823 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 06:14:53.618869 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 06:14:53.619580 20973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.615286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:34967 (local address 127.0.176.194:39397)
0812 06:14:53.615329 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:53.615331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:53.615340 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:14:53.615373 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:53.615374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:53.615412 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:53.615490 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:14:53.615697 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.616462 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.618014 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.618583 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.618650 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.618659 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:53.619466 (+ 807us) server_negotiation.cc:299] Negotiation successful
0812 06:14:53.619511 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:14:53.619623 20971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.615176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:55771 (local address 127.0.176.193:44659)
0812 06:14:53.615238 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:53.615240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:53.615655 (+ 415us) server_negotiation.cc:407] Connection header received
0812 06:14:53.615765 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:53.615766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:53.615777 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:53.615809 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:14:53.616032 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.616720 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.618055 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.618653 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.618705 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.618713 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:53.619499 (+ 786us) server_negotiation.cc:299] Negotiation successful
0812 06:14:53.619549 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:14:53.619894 20992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.614773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44659 (local address 127.0.176.195:55771)
0812 06:14:53.615592 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:53.615603 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:14:53.615682 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:14:53.615875 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:14:53.615876 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:14:53.615878 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:14:53.615958 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:53.615960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.616830 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.616831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:53.617934 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:14:53.617937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.619310 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.619312 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:14:53.619402 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.619407 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:14:53.619748 (+ 341us) client_negotiation.cc:240] Negotiation successful
0812 06:14:53.619792 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":798,"thread_start_us":95,"threads_started":1}
I20260812 06:14:53.619874 20638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b6e9ce9eee4f8a8aebb500c6ae4f56" candidate_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb2e7f978e8403b82823e145a98021b" is_pre_election: true
I20260812 06:14:53.620036 20638 raft_consensus.cc:2454] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08d8ba201a6d4df5920b5f4f2a77368e in term 0.
I20260812 06:14:53.620328 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b6e9ce9eee4f8a8aebb500c6ae4f56" candidate_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99754bf6e821499fbd7bdd1d10affdb1" is_pre_election: true
I20260812 06:14:53.620369 20762 leader_election.cc:302] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08d8ba201a6d4df5920b5f4f2a77368e, 5fb2e7f978e8403b82823e145a98021b; no voters:
I20260812 06:14:53.620476 20371 raft_consensus.cc:2454] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08d8ba201a6d4df5920b5f4f2a77368e in term 0.
I20260812 06:14:53.620524 20991 raft_consensus.cc:2781] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:14:53.620569 20991 raft_consensus.cc:482] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:14:53.620594 20991 raft_consensus.cc:3037] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:14:53.621562 20991 raft_consensus.cc:504] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42227 } } peers { permanent_uuid: "5fb2e7f978e8403b82823e145a98021b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39397 } } peers { permanent_uuid: "99754bf6e821499fbd7bdd1d10affdb1" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44659 } }
I20260812 06:14:53.621737 20991 leader_election.cc:288] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [CANDIDATE]: Term 1 election: Requested vote from peers 5fb2e7f978e8403b82823e145a98021b (127.0.176.194:39397), 99754bf6e821499fbd7bdd1d10affdb1 (127.0.176.193:44659)
I20260812 06:14:53.621971 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b6e9ce9eee4f8a8aebb500c6ae4f56" candidate_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99754bf6e821499fbd7bdd1d10affdb1"
I20260812 06:14:53.621973 20638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b6e9ce9eee4f8a8aebb500c6ae4f56" candidate_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb2e7f978e8403b82823e145a98021b"
I20260812 06:14:53.622057 20638 raft_consensus.cc:3037] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:14:53.622061 20371 raft_consensus.cc:3037] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:14:53.622934 20638 raft_consensus.cc:2454] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08d8ba201a6d4df5920b5f4f2a77368e in term 1.
I20260812 06:14:53.622941 20371 raft_consensus.cc:2454] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08d8ba201a6d4df5920b5f4f2a77368e in term 1.
I20260812 06:14:53.623189 20765 leader_election.cc:302] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08d8ba201a6d4df5920b5f4f2a77368e, 99754bf6e821499fbd7bdd1d10affdb1; no voters:
I20260812 06:14:53.623342 20991 raft_consensus.cc:2781] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:14:53.623534 20991 raft_consensus.cc:686] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [term 1 LEADER]: Becoming Leader. State: Replica: 08d8ba201a6d4df5920b5f4f2a77368e, State: Running, Role: LEADER
I20260812 06:14:53.623636 20991 consensus_queue.cc:237] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42227 } } peers { permanent_uuid: "5fb2e7f978e8403b82823e145a98021b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39397 } } peers { permanent_uuid: "99754bf6e821499fbd7bdd1d10affdb1" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44659 } }
I20260812 06:14:53.624529 20106 catalog_manager.cc:5495] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e reported cstate change: term changed from 0 to 1, leader changed from <none> to 08d8ba201a6d4df5920b5f4f2a77368e (127.0.176.195). New cstate: current_term: 1 leader_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d8ba201a6d4df5920b5f4f2a77368e" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb2e7f978e8403b82823e145a98021b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99754bf6e821499fbd7bdd1d10affdb1" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44659 } health_report { overall_health: UNKNOWN } } }
I20260812 06:14:53.712698 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.708572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34738 (local address 127.0.176.195:42227)
0812 06:14:53.708693 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 06:14:53.708696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:14:53.708703 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:14:53.708747 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:14:53.708748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:14:53.708774 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:14:53.708837 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:14:53.709399 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.710299 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.711529 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:14:53.711830 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:14:53.711891 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:14:53.712097 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:14:53.712243 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:14:53.712334 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 06:14:53.712589 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 06:14:53.712615 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 06:14:53.714998 20638 raft_consensus.cc:1261] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 5fb2e7f978e8403b82823e145a98021b [term 1 FOLLOWER]: Refusing update from remote peer 08d8ba201a6d4df5920b5f4f2a77368e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:14:53.715431 20993 consensus_queue.cc:1035] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb2e7f978e8403b82823e145a98021b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:14:53.716171 20371 raft_consensus.cc:1261] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 99754bf6e821499fbd7bdd1d10affdb1 [term 1 FOLLOWER]: Refusing update from remote peer 08d8ba201a6d4df5920b5f4f2a77368e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:14:53.716671 20993 consensus_queue.cc:1035] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "99754bf6e821499fbd7bdd1d10affdb1" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:14:53.723510 20997 mvcc.cc:205] Tried to move back new op lower bound from 7317566643053568000 to 7317566642682945536. Current Snapshot: MvccSnapshot[applied={T|T < 7317566643053568000}]
I20260812 06:14:53.723832 21000 mvcc.cc:205] Tried to move back new op lower bound from 7317566643053568000 to 7317566642682945536. Current Snapshot: MvccSnapshot[applied={T|T < 7317566643053568000}]
I20260812 06:14:53.725914 20998 mvcc.cc:205] Tried to move back new op lower bound from 7317566643053568000 to 7317566642682945536. Current Snapshot: MvccSnapshot[applied={T|T < 7317566643053568000}]
I20260812 06:14:53.729417 20106 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:14:53.729543 20106 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:14:53.730505 20106 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d6c6acb9a94f41eb9abee2fca2586aff: Sending DeleteTablet for 3 replicas of tablet 57b6e9ce9eee4f8a8aebb500c6ae4f56
I20260812 06:14:53.731019 20609 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b6e9ce9eee4f8a8aebb500c6ae4f56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:14:53 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:56738
I20260812 06:14:53.731253 20326 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b6e9ce9eee4f8a8aebb500c6ae4f56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:14:53 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:44438
I20260812 06:14:53.731751 20832 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b6e9ce9eee4f8a8aebb500c6ae4f56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:14:53 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:34722
I20260812 06:14:53.732419 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 20244
W20260812 06:14:53.745502 20085 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:44659 (error 108)
I20260812 06:14:53.746330 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 20490
I20260812 06:14:53.767534 21011 tablet_replica.cc:330] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e: stopping tablet replica
I20260812 06:14:53.767831 21011 raft_consensus.cc:2229] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:14:53.768082 21011 raft_consensus.cc:2258] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:14:53.772739 21011 ts_tablet_manager.cc:1905] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:14:53.774645 21011 ts_tablet_manager.cc:1918] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:14:53.774825 21011 log.cc:1196] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/57b6e9ce9eee4f8a8aebb500c6ae4f56
I20260812 06:14:53.775203 21011 ts_tablet_manager.cc:1939] T 57b6e9ce9eee4f8a8aebb500c6ae4f56 P 08d8ba201a6d4df5920b5f4f2a77368e: Deleting consensus metadata
I20260812 06:14:53.775833 20083 catalog_manager.cc:4841] TS 08d8ba201a6d4df5920b5f4f2a77368e (127.0.176.195:42227): tablet 57b6e9ce9eee4f8a8aebb500c6ae4f56 (table test-table [id=b858ef2dfae341c881aa2086829c7e6b]) successfully deleted
I20260812 06:14:53.778120 21015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.777601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44659 (local address 127.0.0.1:44452)
0812 06:14:53.778028 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:53.778076 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:44659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":62,"threads_started":1}
I20260812 06:14:53.778484 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 20726
I20260812 06:14:53.778355 21017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:14:53.777755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:39397 (local address 127.0.0.1:56752)
0812 06:14:53.778301 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0812 06:14:53.778329 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.194:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":33,"threads_started":1}
W20260812 06:14:53.794023 20085 catalog_manager.cc:4584] TS 99754bf6e821499fbd7bdd1d10affdb1 (127.0.176.193:44659): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 57b6e9ce9eee4f8a8aebb500c6ae4f56: Network error: Client connection negotiation failed: client connection to 127.0.176.193:44659: connect: Connection refused (error 111)
I20260812 06:14:53.804473 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 20056
I20260812 06:14:53.826182 707 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 06:14:54.177347 707 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 06:14:54.177464 707 mini_ranger.cc:66] Stopping Ranger...
I20260812 06:14:54.533267 707 mini_ranger.cc:68] Stopped Ranger
2026-08-12 06:14:54.533 UTC [19313] LOG: received smart shutdown request
2026-08-12 06:14:54.537 UTC [19313] LOG: background worker "logical replication launcher" (PID 19331) exited with exit code 1
2026-08-12 06:14:54.537 UTC [19323] LOG: shutting down
2026-08-12 06:14:54.710 UTC [19313] LOG: database system is shut down
2026-08-12T06:14:54Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (51665 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:14:54 dist-test-slave-gw5c krb5kdc[21028](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:14:54 dist-test-slave-gw5c krb5kdc[21028](info): set up 2 sockets
Aug 12 06:14:54 dist-test-slave-gw5c krb5kdc[21028](info): commencing operation
krb5kdc: starting...
W20260812 06:14:56.134204 707 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:14:56 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:14:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:14:56Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.0.176.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.0.176.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/rangeradmin_127.0.176.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/rangeradmin_127.0.176.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.0.176.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.0.176.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/rangerlookup_127.0.176.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/rangerlookup_127.0.176.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.0.176.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.0.176.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/HTTP_127.0.176.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/HTTP_127.0.176.212@KRBTEST.COM.keytab.
I20260812 06:14:56.327067 707 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskuoICiU/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/postgres -l logfile start
2026-08-12 06:14:58.890 UTC [21080] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 06:14:58.890 UTC [21080] LOG: listening on IPv4 address "127.0.176.212", port 37263
2026-08-12 06:14:58.893 UTC [21080] LOG: listening on Unix socket "/tmp/.s.PGSQL.37263"
2026-08-12 06:14:58.915 UTC [21084] LOG: database system was shut down at 2026-08-12 06:14:57 UTC
2026-08-12 06:14:58.919 UTC [21080] LOG: database system is ready to accept connections
I20260812 06:15:00.146589 707 mini_postgres.cc:96] Postgres bound to 37263
2026-08-12 06:15:00.154 UTC [21094] FATAL: database "slave" does not exist
127.0.176.212:37263 - accepting connections
I20260812 06:15:00.155354 707 mini_ranger.cc:161] Starting Ranger...
I20260812 06:15:00.172618 707 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 06:15:00.639532 707 mini_ranger.cc:87] Created ranger Postgres database
I20260812 06:15:00.639635 707 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-admin
2026-08-12 06:15:00,953 [I] DB FLAVOR :POSTGRES
2026-08-12 06:15:00,954 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:15:00,954 [I] Checking connection..
2026-08-12 06:15:00,954 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 06:15:01,242 [I] Checking connection passed.
2026-08-12 06:15:01,242 [I] --------- Verifying version history table ---------
2026-08-12 06:15:01,242 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:15:01,519 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:15:01,520 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:15:01,807 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:15:01,808 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 06:15:01,808 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 06:15:02.092 UTC [21205] WARNING: there is no transaction in progress
2026-08-12 06:15:02,102 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 06:15:02,103 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:15:02,391 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 06:15:02,391 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:15:02,392 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 06:15:02,660 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 06:15:02,946 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gw5c.c.gcp-upstream.internal','N') ;"
2026-08-12 06:15:03,220 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:15:03,520 [I] Table x_portal_user does not exist in database ranger
2026-08-12 06:15:03,520 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:15:03,819 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 06:15:03,820 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:15:04,122 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:15:04,390 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 06:15:04,391 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 06:15:05.469 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.489 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.507 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.525 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.543 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.565 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.627 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.634 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.650 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.661 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.672 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.687 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.697 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.705 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.712 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:05.720 UTC [21397] WARNING: there is no transaction in progress
2026-08-12 06:15:06,419 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 06:15:06,420 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 06:15:06,694 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 06:15:06,695 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:15:06,982 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 06:15:06,982 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:15:07,271 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 06:15:07,271 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:15:07,550 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:15:07,828 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gw5c.c.gcp-upstream.internal';"
2026-08-12 06:15:08,106 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 06:15:08,106 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 06:15:08,391 [I] DB_PATCHES have already been applied
I20260812 06:15:08.399228 707 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-admin:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskuoICiU/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 06:15:08.399330 707 mini_ranger.cc:193] Using host: 127.0.176.212
I20260812 06:15:08.406527 707 mini_ranger.cc:227] Ranger admin URL: http://127.0.176.212:39671
Aug 12, 2026 6:15:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:15:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:15:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 6:15:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 6:15:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 6:15:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 6:15:09 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 06:15:09.815065 707 mini_ranger.cc:160] Time spent starting Ranger: real 9.660s user 0.000s sys 0.015s
Aug 12, 2026 6:15:32 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 6:15:32 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 6:15:32 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 6:15:32 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 6:15:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 6:15:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 6:15:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 6:15:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 6:15:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 6:15:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 6:15:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 6:15:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 6:15:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 6:15:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 6:15:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 6:15:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 6:15:32 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 6:15:33 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 06:15:34.061756 707 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.0.176.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.0.176.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/rangerkms_127.0.176.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.0.176.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/rangerkms_127.0.176.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.0.176.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.0.176.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.0.176.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/HTTP_127.0.176.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.0.176.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/HTTP_127.0.176.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 06:15:34 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515334, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 06:15:34.152376 707 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 06:15:34.163513 707 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 06:15:34.999675 707 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 06:15:34.999782 707 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-kms
I20260812 06:15:34.999804 707 mini_ranger_kms.cc:227] Using postgres at 127.0.176.212:37263
2026-08-12 06:15:35,229 [I] DB FLAVOR :POSTGRES
2026-08-12 06:15:35,230 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:15:35,230 [I] Checking connection
2026-08-12 06:15:35,230 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 06:15:35,546 [I] connection success
2026-08-12 06:15:35,546 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 06:15:35,546 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 06:15:35,546 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 06:15:35,866 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 06:15:35,867 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:15:35,867 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 06:15:35,867 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.0.176.212:37263/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 06:15:36,160 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 06:15:36.722355 707 mini_ranger_kms.cc:310] Created kms service
I20260812 06:15:36.952173 707 mini_ranger_kms.cc:326] Created kudu user
I20260812 06:15:37.001629 707 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 06:15:37 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515334, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:15:37.445295 707 mini_ranger_kms.cc:384] Added ranger policy
I20260812 06:15:37.445539 707 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-kms:/tmp/dist-test-taskuoICiU/build/release/bin/postgresql.jar:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskuoICiU/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 06:15:37.445566 707 mini_ranger_kms.cc:240] Using host: 127.0.176.212
I20260812 06:15:37.449937 707 mini_ranger_kms.cc:276] Ranger KMS PID: 21704
I20260812 06:15:37.450031 707 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.0.176.212:49955
Aug 12, 2026 6:15:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:15:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:15:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 6:15:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 6:15:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 6:15:39 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 06:15:39 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515339, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.176.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:40.360697 707 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.208s user 0.000s sys 0.197s
I20260812 06:15:40.360805 707 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 06:15:40.360855 707 mini_ranger_kms.cc:401] 127.0.176.212:49955/kms/v1/keys
Aug 12 06:15:40 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515339, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.176.212@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
Aug 12 06:15:40 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515339, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.0.176.212@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
Aug 12 06:15:43 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515343, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:15:43.438750 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:40299
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:40299
--ranger_config_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.176.212:49955/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:43.532630 21789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:43.532896 21789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:43.532938 21789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:43.534152 21789 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:15:43.534228 21789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:43.534255 21789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:43.534286 21789 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:15:43.534315 21789 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:15:43.536194 21789 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/wal
--ranger_kms_url=127.0.176.212:49955/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:40299
--ranger_config_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:40299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21789
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:43.536507 21789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:43.536749 21789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:43.542177 21798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:43.542255 21803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:43.542176 21799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:43.542904 21789 server_base.cc:1034] running on GCE node
I20260812 06:15:43.543218 21789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:43.543594 21789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:43.544763 21789 hybrid_clock.cc:648] HybridClock initialized: now 1786515343544744 us; error 38 us; skew 500 ppm
Aug 12 06:15:43 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515343, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:43.548007 21789 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:15:43.548568 21789 webserver.cc:460] Webserver started at http://127.0.176.254:38263/ using document root <none> and password file <none>
I20260812 06:15:43.548820 21789 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:43.548883 21789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:43.549052 21789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:15:43 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515343, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:15:43.599746 21789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "eafeaac17fe94e93a47b461adae1ec11"
format_stamp: "Formatted at 2026-08-12 06:15:43 on dist-test-slave-gw5c"
server_key: "7fb55f3c68e100ce0f504ba38b224cab"
server_key_iv: "017c563a2afae9c00416a0cb4f0b95ae"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:43.600216 21789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "eafeaac17fe94e93a47b461adae1ec11"
format_stamp: "Formatted at 2026-08-12 06:15:43 on dist-test-slave-gw5c"
server_key: "7fb55f3c68e100ce0f504ba38b224cab"
server_key_iv: "017c563a2afae9c00416a0cb4f0b95ae"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:43.601759 21789 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:15:43.614718 21815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:43.614979 21789 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:43.615100 21789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "eafeaac17fe94e93a47b461adae1ec11"
format_stamp: "Formatted at 2026-08-12 06:15:43 on dist-test-slave-gw5c"
server_key: "7fb55f3c68e100ce0f504ba38b224cab"
server_key_iv: "017c563a2afae9c00416a0cb4f0b95ae"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:43.615224 21789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:43.623159 21789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:43.625350 21789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:43.625545 21789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:43.630775 21789 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:40299
I20260812 06:15:43.630802 21900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:40299 every 8 connection(s)
I20260812 06:15:43.631227 21789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:15:43.632048 21902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:43.634500 21902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11: Bootstrap starting.
I20260812 06:15:43.635162 21902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:43.635555 21902 log.cc:824] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:43.636341 21902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11: No bootstrap required, opened a new log
I20260812 06:15:43.636660 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 21789
I20260812 06:15:43.636772 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:15:43.636982 707 external_mini_cluster.cc:1428] Setting key 559f751642cb2ae4257a6189a1086681
I20260812 06:15:43.640599 21902 raft_consensus.cc:348] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafeaac17fe94e93a47b461adae1ec11" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40299 } }
I20260812 06:15:43.640797 21902 raft_consensus.cc:374] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:43.640830 21902 raft_consensus.cc:729] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafeaac17fe94e93a47b461adae1ec11, State: Initialized, Role: FOLLOWER
I20260812 06:15:43.640959 21902 consensus_queue.cc:260] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafeaac17fe94e93a47b461adae1ec11" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40299 } }
I20260812 06:15:43.641088 21902 raft_consensus.cc:388] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:15:43.641142 21902 raft_consensus.cc:482] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:15:43.641196 21902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:43.642048 21902 raft_consensus.cc:504] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafeaac17fe94e93a47b461adae1ec11" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40299 } }
I20260812 06:15:43.642172 21902 leader_election.cc:302] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eafeaac17fe94e93a47b461adae1ec11; no voters:
I20260812 06:15:43.642372 21902 leader_election.cc:288] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:15:43.642644 21908 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:15:43.642745 21902 sys_catalog.cc:564] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:15:43.642861 21908 raft_consensus.cc:686] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 1 LEADER]: Becoming Leader. State: Replica: eafeaac17fe94e93a47b461adae1ec11, State: Running, Role: LEADER
I20260812 06:15:43.643038 21908 consensus_queue.cc:237] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafeaac17fe94e93a47b461adae1ec11" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40299 } }
I20260812 06:15:43.643549 21908 sys_catalog.cc:455] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eafeaac17fe94e93a47b461adae1ec11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafeaac17fe94e93a47b461adae1ec11" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40299 } } }
I20260812 06:15:43.643718 21908 sys_catalog.cc:458] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:43.644048 21908 sys_catalog.cc:455] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eafeaac17fe94e93a47b461adae1ec11. Latest consensus state: current_term: 1 leader_uuid: "eafeaac17fe94e93a47b461adae1ec11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafeaac17fe94e93a47b461adae1ec11" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40299 } } }
I20260812 06:15:43.644270 21908 sys_catalog.cc:458] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:43.644363 21902 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 06:15:43.644484 21930 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 06:15:43 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515343, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:43.645112 21930 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:15:43.653681 21937 mvcc.cc:205] Tried to move back new op lower bound from 7317566847603216384 to 7317566847562559488. Current Snapshot: MvccSnapshot[applied={T|T < 7317566847603216384}]
I20260812 06:15:43.654395 21930 catalog_manager.cc:1347] Generated new cluster ID: c2fe3c1333af441f9b16f4894f9ae08a
I20260812 06:15:43.654462 21930 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:15:43.655687 21906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:43.637628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51480 (local address 127.0.176.254:40299)
0812 06:15:43.637897 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:43.637905 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:43.637930 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:15:43.638939 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:43.638947 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:43.639016 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:43.639182 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:43.639910 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:43.640876 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:43.641778 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:43.642223 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:43.642410 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:43.647477 (+ 5067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:43.647537 (+ 60us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:43.647537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:43.647665 (+ 128us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:43.653284 (+ 5619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:43.653809 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:43.653813 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:43.653814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:43.653920 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:43.654121 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:43.654121 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:43.654122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:43.654474 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:43.654611 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:43.655163 (+ 552us) server_negotiation.cc:299] Negotiation successful
0812 06:15:43.655361 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":142,"threads_started":1}
I20260812 06:15:43.663743 21930 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:15:43.664613 21930 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:15:43.672435 21930 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11: Generated new TSK 0
I20260812 06:15:43.672742 21930 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:15:44.454947 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.176.212:49955/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:40299
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:44.549806 21976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:44.550127 21976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:44.550172 21976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:44.551596 21976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:44.551668 21976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:44.551718 21976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:15:44.553604 21976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.0.176.212:49955/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:40299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:44.553927 21976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:44.554224 21976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:44.559427 21984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:44.559446 21988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:44.559829 21983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:44.560418 21976 server_base.cc:1034] running on GCE node
I20260812 06:15:44.560635 21976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:44.560925 21976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:44.562090 21976 hybrid_clock.cc:648] HybridClock initialized: now 1786515344562072 us; error 34 us; skew 500 ppm
Aug 12 06:15:44 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515344, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:44.564880 21976 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:15:44.565394 21976 webserver.cc:460] Webserver started at http://127.0.176.193:40105/ using document root <none> and password file <none>
I20260812 06:15:44.565665 21976 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:44.565737 21976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:44.565905 21976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:15:44 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515344, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:15:44.578655 21976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "26bad7eae5264088b74da32f3ed9a163"
format_stamp: "Formatted at 2026-08-12 06:15:44 on dist-test-slave-gw5c"
server_key: "47593697d97a15051220213ff4cfff0a"
server_key_iv: "0d7affb79c932245cec565b553443c7c"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:44.579195 21976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "26bad7eae5264088b74da32f3ed9a163"
format_stamp: "Formatted at 2026-08-12 06:15:44 on dist-test-slave-gw5c"
server_key: "47593697d97a15051220213ff4cfff0a"
server_key_iv: "0d7affb79c932245cec565b553443c7c"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:44.581287 21976 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 06:15:44.604682 22001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:44.604920 21976 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 06:15:44.605031 21976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "26bad7eae5264088b74da32f3ed9a163"
format_stamp: "Formatted at 2026-08-12 06:15:44 on dist-test-slave-gw5c"
server_key: "47593697d97a15051220213ff4cfff0a"
server_key_iv: "0d7affb79c932245cec565b553443c7c"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:44.605152 21976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:44.627178 21976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:44.630023 21976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:44.630282 21976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:44.631556 21976 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:44.632006 21976 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:15:44.632076 21976 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:44.632124 21976 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:15:44.632157 21976 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:44.639583 21976 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:36527
I20260812 06:15:44.640156 21976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:15:44.640904 22188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:36527 every 8 connection(s)
I20260812 06:15:44.643931 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 21976
I20260812 06:15:44.644058 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:15:44.644277 707 external_mini_cluster.cc:1428] Setting key 6d731cbdf3503f2f380a0b15dee5d520
Aug 12 06:15:44 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515344, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:44.656638 22193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:44.641928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:40299 (local address 127.0.176.193:46407)
0812 06:15:44.642930 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:44.642987 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:44.644919 (+ 1932us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:44.645362 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:44.645367 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:44.645672 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:44.645974 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:44.645981 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:44.646969 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:44.646970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:44.648349 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:44.648354 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:44.648974 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:44.648975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:44.649199 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:44.650066 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:44.650079 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:44.652060 (+ 1981us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:44.654550 (+ 2490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:44.654564 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:44.654567 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:44.654952 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:44.655213 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:44.655214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:44.655214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:44.655421 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:44.655773 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:44.655781 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:44.655983 (+ 202us) client_negotiation.cc:769] Sending connection context
0812 06:15:44.656100 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 06:15:44.656314 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":946,"thread_start_us":116,"threads_started":1}
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
I20260812 06:15:44.657330 22197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:44.642295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:46407 (local address 127.0.176.254:40299)
0812 06:15:44.642479 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:44.642482 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:44.643110 (+ 628us) server_negotiation.cc:407] Connection header received
0812 06:15:44.645118 (+ 2008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:44.645119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:44.645135 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:44.645207 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:44.646099 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:44.646839 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:44.648478 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:44.648802 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:44.648871 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:44.652218 (+ 3347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:44.652221 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:44.652221 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:44.652232 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:44.654414 (+ 2182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:44.655057 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:44.655058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:44.655059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:44.655134 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:44.655504 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:44.655505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:44.655506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:44.655674 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:44.655742 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:44.657076 (+ 1334us) server_negotiation.cc:299] Negotiation successful
0812 06:15:44.657184 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
I20260812 06:15:44.658169 22191 heartbeater.cc:347] Connected to a master server at 127.0.176.254:40299
I20260812 06:15:44.658280 22191 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:44.658491 22191 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
I20260812 06:15:44.659161 21844 ts_manager.cc:194] Registered new tserver with Master: 26bad7eae5264088b74da32f3ed9a163 (127.0.176.193:36527)
I20260812 06:15:44.660166 21844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:46407
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:15:44.682451 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.176.212:49955/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:40299
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:44.807425 22205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:44.807729 22205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:44.807773 22205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:44.809751 22205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:44.809870 22205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:44.809939 22205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:15:44.812475 22205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.0.176.212:49955/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:40299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:44.812789 22205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:44.813148 22205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:15:44.820642 22205 server_base.cc:1034] running on GCE node
W20260812 06:15:44.820711 22222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:44.820545 22219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:44.821198 22218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:44.821532 22205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:44.821852 22205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:44.823063 22205 hybrid_clock.cc:648] HybridClock initialized: now 1786515344823024 us; error 52 us; skew 500 ppm
Aug 12 06:15:44 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515344, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:44.826858 22205 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:15:44.827570 22205 webserver.cc:460] Webserver started at http://127.0.176.194:35039/ using document root <none> and password file <none>
I20260812 06:15:44.827927 22205 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:44.827998 22205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:44.828203 22205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:15:44 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515344, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
Aug 12 06:15:44 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515344, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:44.845332 22205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "c777d859a0b64c409ee8b1c506ff0edd"
format_stamp: "Formatted at 2026-08-12 06:15:44 on dist-test-slave-gw5c"
server_key: "bde40e7f635d50a781bf0fa2b8cf3258"
server_key_iv: "1d2dffa20abb9d55452dd78fe511ee3a"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:44.845830 22205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "c777d859a0b64c409ee8b1c506ff0edd"
format_stamp: "Formatted at 2026-08-12 06:15:44 on dist-test-slave-gw5c"
server_key: "bde40e7f635d50a781bf0fa2b8cf3258"
server_key_iv: "1d2dffa20abb9d55452dd78fe511ee3a"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:44.858983 22205 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.001s sys 0.000s
I20260812 06:15:44.877018 22233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:44.883633 22205 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.000s sys 0.001s
I20260812 06:15:44.883800 22205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "c777d859a0b64c409ee8b1c506ff0edd"
format_stamp: "Formatted at 2026-08-12 06:15:44 on dist-test-slave-gw5c"
server_key: "bde40e7f635d50a781bf0fa2b8cf3258"
server_key_iv: "1d2dffa20abb9d55452dd78fe511ee3a"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:44.883930 22205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:44.920120 22205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:44.922622 22205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:44.922819 22205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:44.923089 22205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:44.923614 22205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:15:44.923676 22205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:44.923743 22205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:15:44.923774 22205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:44.934018 22205 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:39403
I20260812 06:15:44.934698 22205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:15:44.935233 22419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:39403 every 8 connection(s)
I20260812 06:15:44.939500 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 22205
I20260812 06:15:44.939620 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:15:44.939854 707 external_mini_cluster.cc:1428] Setting key 97ce245549777a8dab95258892e51872
Aug 12 06:15:44 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515344, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:44.948956 22197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:44.936508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:33613 (local address 127.0.176.254:40299)
0812 06:15:44.936563 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:44.936565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:44.936998 (+ 433us) server_negotiation.cc:407] Connection header received
0812 06:15:44.937835 (+ 837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:44.937837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:44.937856 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:44.937894 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:44.938848 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:44.939660 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:44.941224 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:44.941554 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:44.941605 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:44.944771 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:44.944773 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:44.944773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:44.944782 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:44.946851 (+ 2069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:44.947632 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:44.947634 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:44.947634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:44.947724 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:44.948064 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:44.948065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:44.948065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:44.948229 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:44.948284 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:44.948725 (+ 441us) server_negotiation.cc:299] Negotiation successful
0812 06:15:44.948844 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:15:44.949898 22426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:44.936177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:40299 (local address 127.0.176.194:33613)
0812 06:15:44.936846 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:44.936893 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:44.937612 (+ 719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:44.938091 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:44.938095 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:44.938391 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:44.938694 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:44.938701 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:44.939826 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:44.939827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:44.941110 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:44.941114 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:44.941744 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:44.941745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:44.941900 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:44.942645 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:44.942657 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:44.944607 (+ 1950us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:44.946970 (+ 2363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:44.946978 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:44.946981 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:44.947499 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:44.947817 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:44.947818 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:44.947818 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:44.947973 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:44.948341 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:44.948348 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:44.948528 (+ 180us) client_negotiation.cc:769] Sending connection context
0812 06:15:44.949396 (+ 868us) client_negotiation.cc:240] Negotiation successful
0812 06:15:44.949616 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":107,"threads_started":1}
I20260812 06:15:44.950724 22424 heartbeater.cc:347] Connected to a master server at 127.0.176.254:40299
I20260812 06:15:44.950840 22424 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:44.951068 22424 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
I20260812 06:15:44.951627 21844 ts_manager.cc:194] Registered new tserver with Master: c777d859a0b64c409ee8b1c506ff0edd (127.0.176.194:39403)
I20260812 06:15:44.952162 21844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:33613
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:15:44.984364 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.176.212:49955/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:40299
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:45.110954 22429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:45.111356 22429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:45.111505 22429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:45.113380 22429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:45.113515 22429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:45.113622 22429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:15:45.116065 22429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.0.176.212:49955/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:40299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:45.116911 22429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:45.117332 22429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:45.124866 22438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:45.125304 22445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:45.126155 22429 server_base.cc:1034] running on GCE node
W20260812 06:15:45.127380 22436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:45.127702 22429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:45.127988 22429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:45.129179 22429 hybrid_clock.cc:648] HybridClock initialized: now 1786515345129152 us; error 40 us; skew 500 ppm
Aug 12 06:15:45 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:45.132866 22429 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:15:45.133428 22429 webserver.cc:460] Webserver started at http://127.0.176.195:38319/ using document root <none> and password file <none>
I20260812 06:15:45.133683 22429 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:45.133733 22429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:45.133860 22429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:15:45 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:15:45.147820 22429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "59463ab3e95d445989da55a7ed2e3d56"
format_stamp: "Formatted at 2026-08-12 06:15:45 on dist-test-slave-gw5c"
server_key: "1e8aa45b0d36964d3e662a07a12e967a"
server_key_iv: "03fe5bb126f179992e155491b3fce77b"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:45.148413 22429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "59463ab3e95d445989da55a7ed2e3d56"
format_stamp: "Formatted at 2026-08-12 06:15:45 on dist-test-slave-gw5c"
server_key: "1e8aa45b0d36964d3e662a07a12e967a"
server_key_iv: "03fe5bb126f179992e155491b3fce77b"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:45.150229 22429 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:45.167567 22453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:45.167824 22429 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 06:15:45.167964 22429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "59463ab3e95d445989da55a7ed2e3d56"
format_stamp: "Formatted at 2026-08-12 06:15:45 on dist-test-slave-gw5c"
server_key: "1e8aa45b0d36964d3e662a07a12e967a"
server_key_iv: "03fe5bb126f179992e155491b3fce77b"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:45.168089 22429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:45.186317 22429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:45.190048 22429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:45.190291 22429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:45.190636 22429 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:45.191115 22429 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:15:45.191215 22429 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:45.191294 22429 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:15:45.191366 22429 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:45.198770 22429 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:43035
I20260812 06:15:45.199364 22429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:15:45.199622 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 22429
I20260812 06:15:45.199753 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:15:45.199982 707 external_mini_cluster.cc:1428] Setting key 34a08e71271cbc67144c002d8b04bc50
I20260812 06:15:45.204614 22643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:43035 every 8 connection(s)
Aug 12 06:15:45 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:45.223181 22197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:45.205260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:46511 (local address 127.0.176.254:40299)
0812 06:15:45.205314 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:45.205317 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:45.205787 (+ 470us) server_negotiation.cc:407] Connection header received
0812 06:15:45.206476 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:45.206478 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:45.206492 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:45.206568 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:45.212522 (+ 5954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:45.213267 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:45.214847 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:45.215136 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:45.215188 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:45.218452 (+ 3264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:45.218454 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:45.218455 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:45.218465 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:45.220553 (+ 2088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:45.221174 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:45.221176 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:45.221177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:45.221247 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:45.221596 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:45.221597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:45.221597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:45.221748 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:45.221798 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:45.222972 (+ 1174us) server_negotiation.cc:299] Negotiation successful
0812 06:15:45.223083 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:15:45.224123 22648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:45.205253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:40299 (local address 127.0.176.195:46511)
0812 06:15:45.205660 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:45.205705 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:45.206340 (+ 635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:45.211008 (+ 4668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:45.211014 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:45.212059 (+ 1045us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:45.212379 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:45.212387 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:45.213417 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:45.213417 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:45.214726 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:45.214730 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:45.215316 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:45.215316 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:45.215547 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:45.216262 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:45.216273 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:45.218252 (+ 1979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:45.220669 (+ 2417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:45.220680 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:45.220683 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:45.221059 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:45.221332 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:45.221332 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:45.221333 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:45.221505 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:45.221855 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:45.221863 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:45.222783 (+ 920us) client_negotiation.cc:769] Sending connection context
0812 06:15:45.223658 (+ 875us) client_negotiation.cc:240] Negotiation successful
0812 06:15:45.223862 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":107,"threads_started":1}
I20260812 06:15:45.224946 22645 heartbeater.cc:347] Connected to a master server at 127.0.176.254:40299
I20260812 06:15:45.225054 22645 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:45.225268 22645 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
I20260812 06:15:45.225741 21844 ts_manager.cc:194] Registered new tserver with Master: 59463ab3e95d445989da55a7ed2e3d56 (127.0.176.195:43035)
I20260812 06:15:45.226253 21844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:46511
I20260812 06:15:45.233412 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:15:45.234462 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 21976
I20260812 06:15:45.251075 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 22205
I20260812 06:15:45.262370 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 22429
I20260812 06:15:45.296962 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 21789
I20260812 06:15:45.315344 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:40299
--webserver_interface=127.0.176.254
--webserver_port=38263
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:40299
--ranger_config_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.176.212:49955/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.0.176.212:49955/kms with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:45.421494 22651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:45.421753 22651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:45.421778 22651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:45.423131 22651 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:15:45.423183 22651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:45.423198 22651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:45.423210 22651 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:15:45.423223 22651 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:15:45.425047 22651 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.0.176.212:49955/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:40299
--ranger_config_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:40299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=38263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:45.425344 22651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:45.425609 22651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:45.430742 22662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:45.430755 22659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:45.430737 22658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:45.431113 22651 server_base.cc:1034] running on GCE node
I20260812 06:15:45.431515 22651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:45.431854 22651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:45.433068 22651 hybrid_clock.cc:648] HybridClock initialized: now 1786515345433051 us; error 34 us; skew 500 ppm
Aug 12 06:15:45 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:45.435945 22651 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:15:45.436465 22651 webserver.cc:460] Webserver started at http://127.0.176.254:38263/ using document root <none> and password file <none>
I20260812 06:15:45.436704 22651 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:45.436781 22651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 06:15:45 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:15:45.508765 22651 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 06:15:45.509975 22676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:45.510226 22651 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:45.510346 22651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "eafeaac17fe94e93a47b461adae1ec11"
format_stamp: "Formatted at 2026-08-12 06:15:43 on dist-test-slave-gw5c"
server_key: "7fb55f3c68e100ce0f504ba38b224cab"
server_key_iv: "017c563a2afae9c00416a0cb4f0b95ae"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:45.510877 22651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:45.527136 22651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:45.530972 22651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:45.531174 22651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:45.537309 22651 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:40299
I20260812 06:15:45.537407 22764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:40299 every 8 connection(s)
I20260812 06:15:45.537866 22651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:15:45.539321 22765 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:15:45.540079 22765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11: Bootstrap starting.
I20260812 06:15:45.544627 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 22651
I20260812 06:15:45.545022 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.176.212:49955/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:36527
--local_ip_for_outbound_sockets=127.0.176.193
--tserver_master_addrs=127.0.176.254:40299
--webserver_port=40105
--webserver_interface=127.0.176.193
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.0.176.212:49955/kms with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:15:45.549027 22765 log.cc:824] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:45.551926 22765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:15:45.552273 22765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11: Bootstrap complete.
I20260812 06:15:45.554888 22765 raft_consensus.cc:348] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafeaac17fe94e93a47b461adae1ec11" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40299 } }
I20260812 06:15:45.555181 22765 raft_consensus.cc:729] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafeaac17fe94e93a47b461adae1ec11, State: Initialized, Role: FOLLOWER
I20260812 06:15:45.555429 22765 consensus_queue.cc:260] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafeaac17fe94e93a47b461adae1ec11" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40299 } }
I20260812 06:15:45.555534 22765 raft_consensus.cc:388] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:15:45.555593 22765 raft_consensus.cc:482] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:15:45.555642 22765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:15:45.556746 22765 raft_consensus.cc:504] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafeaac17fe94e93a47b461adae1ec11" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40299 } }
I20260812 06:15:45.556876 22765 leader_election.cc:302] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eafeaac17fe94e93a47b461adae1ec11; no voters:
I20260812 06:15:45.557135 22765 leader_election.cc:288] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 06:15:45.557178 22771 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:15:45.557384 22771 raft_consensus.cc:686] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [term 2 LEADER]: Becoming Leader. State: Replica: eafeaac17fe94e93a47b461adae1ec11, State: Running, Role: LEADER
I20260812 06:15:45.557482 22765 sys_catalog.cc:564] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:15:45.559154 22771 consensus_queue.cc:237] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafeaac17fe94e93a47b461adae1ec11" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40299 } }
I20260812 06:15:45.559526 22771 sys_catalog.cc:455] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eafeaac17fe94e93a47b461adae1ec11. Latest consensus state: current_term: 2 leader_uuid: "eafeaac17fe94e93a47b461adae1ec11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafeaac17fe94e93a47b461adae1ec11" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40299 } } }
I20260812 06:15:45.559603 22771 sys_catalog.cc:458] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:45.560097 22765 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 06:15:45.560144 22773 sys_catalog.cc:455] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "eafeaac17fe94e93a47b461adae1ec11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eafeaac17fe94e93a47b461adae1ec11" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40299 } } }
I20260812 06:15:45.560214 22773 sys_catalog.cc:458] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11 [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:45.560314 22793 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:15:45.563207 22793 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:15:45.563503 22793 catalog_manager.cc:1259] Loaded cluster ID: c2fe3c1333af441f9b16f4894f9ae08a
I20260812 06:15:45.563552 22793 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:15:45.565590 22793 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:15:45.565871 22793 catalog_manager.cc:5879] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11: Loaded TSK: 0
I20260812 06:15:45.566159 22793 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:15:45.641227 22767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:45.641523 22767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:45.641571 22767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:45.642946 22767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:45.643041 22767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:45.643100 22767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:15:45.645503 22767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.0.176.212:49955/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:36527
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=40105
--tserver_master_addrs=127.0.176.254:40299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:45.645834 22767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:45.646153 22767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:45.655767 22826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:45.655767 22821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:45.655769 22822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:45.656279 22767 server_base.cc:1034] running on GCE node
I20260812 06:15:45.656723 22767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:45.657063 22767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:45.664463 22767 hybrid_clock.cc:648] HybridClock initialized: now 1786515345664377 us; error 115 us; skew 500 ppm
Aug 12 06:15:45 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:45.668286 22767 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:15:45.668919 22767 webserver.cc:460] Webserver started at http://127.0.176.193:40105/ using document root <none> and password file <none>
I20260812 06:15:45.669214 22767 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:45.669296 22767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 06:15:45 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:15:45.699952 22767 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.001s sys 0.000s
I20260812 06:15:45.700883 22841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:45.701051 22767 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:15:45.701144 22767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "26bad7eae5264088b74da32f3ed9a163"
format_stamp: "Formatted at 2026-08-12 06:15:44 on dist-test-slave-gw5c"
server_key: "47593697d97a15051220213ff4cfff0a"
server_key_iv: "0d7affb79c932245cec565b553443c7c"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:45.701660 22767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:45.747988 22767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:45.751248 22767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:45.751485 22767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:45.751720 22767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:45.752102 22767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:15:45.752147 22767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:45.752178 22767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:15:45.752205 22767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:45.759649 22767 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:36527
I20260812 06:15:45.760228 22767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:15:45.763530 23042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:36527 every 8 connection(s)
I20260812 06:15:45.768579 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 22767
I20260812 06:15:45.768927 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.176.212:49955/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:39403
--local_ip_for_outbound_sockets=127.0.176.194
--tserver_master_addrs=127.0.176.254:40299
--webserver_port=35039
--webserver_interface=127.0.176.194
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.0.176.212:49955/kms with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:15:45 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:45.784487 23049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:45.764259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:40299 (local address 127.0.176.193:56821)
0812 06:15:45.764859 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:45.764906 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:45.765542 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:45.769587 (+ 4045us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:45.769592 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:45.769893 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:45.772651 (+ 2758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:45.772662 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:45.774438 (+ 1776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:45.774440 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:45.775814 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:45.775819 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:45.776875 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:45.776877 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:45.777024 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:45.777749 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:45.777761 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:45.779603 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:45.782268 (+ 2665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:45.782280 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:45.782283 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:45.782653 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:45.782984 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:45.782985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:45.782985 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:45.783134 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:45.783732 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:45.783740 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:45.783909 (+ 169us) client_negotiation.cc:769] Sending connection context
0812 06:15:45.784018 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 06:15:45.784208 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":106,"threads_started":1}
I20260812 06:15:45.785063 23050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:45.764640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:56821 (local address 127.0.176.254:40299)
0812 06:15:45.765769 (+ 1129us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:45.765778 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:45.765814 (+ 36us) server_negotiation.cc:407] Connection header received
0812 06:15:45.765962 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:45.765969 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:45.769217 (+ 3248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:45.769395 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:45.772841 (+ 3446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:45.774261 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:45.775945 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:45.776606 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:45.776740 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:45.779765 (+ 3025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:45.779771 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:45.779771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:45.779787 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:45.782151 (+ 2364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:45.782763 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:45.782767 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:45.782768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:45.782896 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:45.783218 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:45.783219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:45.783220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:45.783603 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:45.783698 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:45.784715 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0812 06:15:45.784855 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1051,"thread_start_us":72,"threads_started":1}
I20260812 06:15:45.786106 23043 heartbeater.cc:347] Connected to a master server at 127.0.176.254:40299
I20260812 06:15:45.786206 23043 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:45.786425 23043 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
W20260812 06:15:45.787516 23043 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:40299 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 06:15:45.787592 23043 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:45.787659 23043 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
I20260812 06:15:45.788091 23043 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:45.788172 23043 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
W20260812 06:15:45.788592 23043 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:15:45.903967 23051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:45.904290 23051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:45.904345 23051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:45.906349 23051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:45.906430 23051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:45.906486 23051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:15:45.909189 23051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.0.176.212:49955/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:39403
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=35039
--tserver_master_addrs=127.0.176.254:40299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:45.909555 23051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:45.909904 23051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:45.917747 23056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:45.917747 23061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:45.917774 23058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:45.918054 23051 server_base.cc:1034] running on GCE node
I20260812 06:15:45.918419 23051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:45.918730 23051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:45.919921 23051 hybrid_clock.cc:648] HybridClock initialized: now 1786515345919906 us; error 30 us; skew 500 ppm
Aug 12 06:15:45 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:45.922925 23051 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:15:45.923570 23051 webserver.cc:460] Webserver started at http://127.0.176.194:35039/ using document root <none> and password file <none>
I20260812 06:15:45.923842 23051 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:45.923939 23051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 06:15:45 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:15:45.944519 23051 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:15:45.945858 23072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:45.946077 23051 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:15:45.946168 23051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "c777d859a0b64c409ee8b1c506ff0edd"
format_stamp: "Formatted at 2026-08-12 06:15:44 on dist-test-slave-gw5c"
server_key: "bde40e7f635d50a781bf0fa2b8cf3258"
server_key_iv: "1d2dffa20abb9d55452dd78fe511ee3a"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:45.946631 23051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:45.972074 23051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:45.974916 23051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:45.975087 23051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:45.975343 23051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:45.975772 23051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:15:45.975811 23051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:45.975835 23051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:15:45.975847 23051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:45.983085 23051 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:39403
I20260812 06:15:45.983312 23252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:39403 every 8 connection(s)
I20260812 06:15:45.983637 23051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:15:45.988801 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 23051
I20260812 06:15:45.989133 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.0.176.212:49955/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:43035
--local_ip_for_outbound_sockets=127.0.176.195
--tserver_master_addrs=127.0.176.254:40299
--webserver_port=38319
--webserver_interface=127.0.176.195
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.0.176.212:49955/kms with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:15:45 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:45.995970 23050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:45.984807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:46349 (local address 127.0.176.254:40299)
0812 06:15:45.984861 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:45.984863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:45.984904 (+ 41us) server_negotiation.cc:407] Connection header received
0812 06:15:45.985645 (+ 741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:45.985646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:45.985658 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:45.985718 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:45.986594 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:45.987105 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:45.988751 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:45.989083 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:45.989139 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:45.992162 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:45.992164 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:45.992164 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:45.992174 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:45.994058 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:45.994636 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:45.994638 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:45.994638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:45.994708 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:45.995039 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:45.995040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:45.995041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:45.995220 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:45.995272 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:45.995753 (+ 481us) server_negotiation.cc:299] Negotiation successful
0812 06:15:45.995853 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:15:45.996845 23256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:45.984531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:40299 (local address 127.0.176.194:46349)
0812 06:15:45.984748 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:45.984807 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:45.985510 (+ 703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:45.985793 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:45.985798 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:45.986141 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:45.986454 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:45.986461 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:45.987221 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:45.987222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:45.988624 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:45.988627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:45.989268 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:45.989270 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:45.989418 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:45.990110 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:45.990121 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:45.992021 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:45.994169 (+ 2148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:45.994179 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:45.994182 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:45.994531 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:45.994786 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:45.994787 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:45.994788 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:45.994934 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:45.995327 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:45.995334 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:45.995566 (+ 232us) client_negotiation.cc:769] Sending connection context
0812 06:15:45.996378 (+ 812us) client_negotiation.cc:240] Negotiation successful
0812 06:15:45.996574 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":102,"threads_started":1}
I20260812 06:15:45.997597 23254 heartbeater.cc:347] Connected to a master server at 127.0.176.254:40299
I20260812 06:15:45.997709 23254 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:45.997926 23254 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
W20260812 06:15:45.998689 23254 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:40299 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 06:15:45.998767 23254 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:45.998842 23254 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
I20260812 06:15:45.999259 23254 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:45.999418 23254 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
W20260812 06:15:45.999794 23254 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:15:46.111186 23257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:46.111500 23257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:46.111541 23257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:46.113309 23257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:46.113375 23257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:46.113425 23257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:15:46.115720 23257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.0.176.212:49955/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:43035
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=38319
--tserver_master_addrs=127.0.176.254:40299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:46.115991 23257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:46.116285 23257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:46.122516 23267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:46.122531 23265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:46.122840 23257 server_base.cc:1034] running on GCE node
W20260812 06:15:46.122850 23272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:46.123116 23257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:46.123481 23257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:46.124691 23257 hybrid_clock.cc:648] HybridClock initialized: now 1786515346124657 us; error 48 us; skew 500 ppm
Aug 12 06:15:46 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515346, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:46.129218 23257 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:15:46.129791 23257 webserver.cc:460] Webserver started at http://127.0.176.195:38319/ using document root <none> and password file <none>
I20260812 06:15:46.130129 23257 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:46.130227 23257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 06:15:46 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515346, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:15:46.157740 23257 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:15:46.158576 23282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:46.158730 23257 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:15:46.158813 23257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "59463ab3e95d445989da55a7ed2e3d56"
format_stamp: "Formatted at 2026-08-12 06:15:45 on dist-test-slave-gw5c"
server_key: "1e8aa45b0d36964d3e662a07a12e967a"
server_key_iv: "03fe5bb126f179992e155491b3fce77b"
server_key_version: "kuduclusterkey@0"
I20260812 06:15:46.159272 23257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:46.178524 23257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:46.181319 23257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:46.181501 23257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:46.181734 23257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:46.182152 23257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:15:46.182204 23257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:46.182237 23257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:15:46.182263 23257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:46.190495 23257 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:43035
I20260812 06:15:46.191021 23257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:15:46.197656 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 23257
I20260812 06:15:46.198735 23464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:43035 every 8 connection(s)
I20260812 06:15:46.208966 23050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:46.198147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54118 (local address 127.0.176.254:40299)
0812 06:15:46.198222 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:46.198225 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:46.199934 (+ 1709us) server_negotiation.cc:407] Connection header received
0812 06:15:46.200021 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:46.200022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:46.200034 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:46.200105 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:46.200868 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:46.201617 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:46.202687 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:46.202983 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:46.203044 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:46.205327 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:46.205328 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:46.205329 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:46.205337 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:46.207204 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:46.208007 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:46.208009 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:46.208010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:46.208084 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:46.208330 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:46.208331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:46.208331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:46.208477 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:46.208680 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:46.208739 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 06:15:46.208857 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
Aug 12 06:15:46 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515346, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:46.213894 23469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:46.199377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:40299 (local address 127.0.176.195:40351)
0812 06:15:46.200916 (+ 1539us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:46.200977 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:46.201589 (+ 612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:46.203034 (+ 1445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:46.203039 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:46.203311 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:46.203658 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:46.203665 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:46.204782 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:46.204783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:46.206122 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:46.206125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:46.206996 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:46.206997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:46.207122 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:46.208036 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:46.208046 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:46.209663 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:46.211963 (+ 2300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:46.211972 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:46.211975 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:46.212236 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:46.212470 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:46.212471 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:46.212472 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:46.212626 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:46.212959 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:46.212966 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:46.213274 (+ 308us) client_negotiation.cc:769] Sending connection context
0812 06:15:46.213402 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 06:15:46.213604 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1433,"thread_start_us":105,"threads_started":1}
I20260812 06:15:46.214396 23468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:46.199362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:40351 (local address 127.0.176.254:40299)
0812 06:15:46.202742 (+ 3380us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:46.202744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:46.202750 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:15:46.202768 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:46.202769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:46.202780 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:46.202819 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:46.203770 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:46.204641 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:46.206243 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:46.206778 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:46.206904 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:46.209781 (+ 2877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:46.209782 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:46.209783 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:46.209791 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:46.211844 (+ 2053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:46.212321 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:46.212322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:46.212322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:46.212392 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:46.212706 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:46.212707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:46.212708 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:46.212850 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:46.212914 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:46.214217 (+ 1303us) server_negotiation.cc:299] Negotiation successful
0812 06:15:46.214330 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3357,"thread_start_us":84,"threads_started":1}
I20260812 06:15:46.214792 23465 heartbeater.cc:347] Connected to a master server at 127.0.176.254:40299
I20260812 06:15:46.214905 23465 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:46.215109 23465 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
W20260812 06:15:46.215893 23465 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:40299 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 06:15:46.215971 23465 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:46.216040 23465 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
I20260812 06:15:46.216400 23465 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:46.216478 23465 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
W20260812 06:15:46.216833 23465 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 06:15:46 dist-test-slave-gw5c krb5kdc[21028](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515346, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:46.788820 23043 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:46.789026 23043 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
I20260812 06:15:46.789513 22697 ts_manager.cc:194] Registered new tserver with Master: 26bad7eae5264088b74da32f3ed9a163 (127.0.176.193:36527)
I20260812 06:15:46.790532 22697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:56821
I20260812 06:15:47.000008 23254 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:47.000224 23254 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
I20260812 06:15:47.000653 22697 ts_manager.cc:194] Registered new tserver with Master: c777d859a0b64c409ee8b1c506ff0edd (127.0.176.194:39403)
I20260812 06:15:47.001187 22697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:46349
Aug 12 06:15:47 dist-test-slave-gw5c krb5kdc[21028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515346, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for HTTP/127.0.176.212@KRBTEST.COM
I20260812 06:15:47.217092 23465 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:47.217268 23465 heartbeater.cc:511] Master 127.0.176.254:40299 requested a full tablet report, sending...
I20260812 06:15:47.217540 22697 ts_manager.cc:194] Registered new tserver with Master: 59463ab3e95d445989da55a7ed2e3d56 (127.0.176.195:43035)
I20260812 06:15:47.218111 22697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:40351
I20260812 06:15:47.228528 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:15:47.239627 23495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.231518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54124 (local address 127.0.176.254:40299)
0812 06:15:47.231692 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:47.231695 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:47.231705 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:15:47.231734 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:47.231735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:47.231748 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:47.231837 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:47.232620 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.233353 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.234421 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.234724 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.234800 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:47.236400 (+ 1600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:47.236402 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:47.236402 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:47.236411 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:47.238265 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:47.238696 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:47.238697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:47.238698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:47.238770 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:47.239004 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:47.239005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:47.239005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:47.239152 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:47.239261 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:47.239383 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 06:15:47.239516 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
I20260812 06:15:47.242017 22697 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54124:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:15:47.244510 22697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:15:47.253557 23506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.247988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:43035 (local address 127.0.0.1:56296)
0812 06:15:47.248914 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:47.248959 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:47.249005 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:47.249192 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:47.249195 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:47.249197 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:47.249273 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:47.249275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.250721 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.250723 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:47.252219 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:47.252262 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.253259 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.253260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:47.253336 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:47.253349 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 06:15:47.253410 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:15:47.253472 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":901,"mutex_wait_us":2,"thread_start_us":112,"threads_started":1}
I20260812 06:15:47.253803 23517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.248457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56296 (local address 127.0.176.195:43035)
0812 06:15:47.248602 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:47.248607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:47.249011 (+ 404us) server_negotiation.cc:407] Connection header received
0812 06:15:47.249061 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:47.249063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:47.249082 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:47.249169 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:47.249359 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.250621 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.252371 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.253075 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.253127 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:47.253189 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:47.253677 (+ 488us) server_negotiation.cc:299] Negotiation successful
0812 06:15:47.253725 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":68,"threads_started":1}
I20260812 06:15:47.256513 23327 tablet_service.cc:1467] Processing CreateTablet for tablet d4c77766d48647218045f60f6f69ccf7 (DEFAULT_TABLE table=test-table [id=d7a37c60b63a4bcd866e1327eda4b7eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:15:47.256939 23327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4c77766d48647218045f60f6f69ccf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:47.262943 23508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.247988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:36527 (local address 127.0.0.1:48972)
0812 06:15:47.248691 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:47.248733 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:47.248801 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:47.251849 (+ 3048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:47.251850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:47.251851 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:47.251916 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:47.251917 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.260212 (+ 8295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.260214 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:47.261438 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:47.261442 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.262590 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.262592 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:47.262682 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:47.262689 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 06:15:47.262760 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 06:15:47.262822 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":96,"threads_started":1}
I20260812 06:15:47.263372 23509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.248100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48972 (local address 127.0.176.193:36527)
0812 06:15:47.251682 (+ 3582us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:47.251688 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:47.251698 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:15:47.251733 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:47.251735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:47.251751 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:47.251986 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:47.252063 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.260067 (+ 8004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.261558 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.262485 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.262563 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:47.262630 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:47.263212 (+ 582us) server_negotiation.cc:299] Negotiation successful
0812 06:15:47.263272 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3544,"thread_start_us":59,"threads_started":1}
I20260812 06:15:47.264218 22900 tablet_service.cc:1467] Processing CreateTablet for tablet d4c77766d48647218045f60f6f69ccf7 (DEFAULT_TABLE table=test-table [id=d7a37c60b63a4bcd866e1327eda4b7eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:15:47.264619 22900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4c77766d48647218045f60f6f69ccf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:47.268512 23519 tablet_bootstrap.cc:492] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163: Bootstrap starting.
I20260812 06:15:47.269296 23519 tablet_bootstrap.cc:654] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:47.269698 23519 log.cc:824] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:47.271600 23518 tablet_bootstrap.cc:492] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56: Bootstrap starting.
I20260812 06:15:47.272313 23518 tablet_bootstrap.cc:654] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:47.272712 23518 log.cc:824] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:47.272948 23516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.248359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35502 (local address 127.0.176.194:39403)
0812 06:15:47.262735 (+ 14376us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:47.262740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:47.262752 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:15:47.262790 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:47.262792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:47.262810 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:47.268695 (+ 5885us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:47.268801 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.270056 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.271501 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.272345 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.272523 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:47.272696 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:47.272737 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 06:15:47.272858 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14326,"thread_start_us":67,"threads_started":1}
I20260812 06:15:47.273284 23511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.248246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:39403 (local address 127.0.0.1:35502)
0812 06:15:47.251504 (+ 3258us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:47.251515 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:47.251566 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:47.262936 (+ 11370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:47.262937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:47.262941 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:47.262989 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:47.262991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.270170 (+ 7179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.270172 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:47.271337 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:47.271342 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.272550 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.272552 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:47.272628 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:47.272635 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 06:15:47.272695 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:15:47.272757 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3237,"thread_start_us":71,"threads_started":1}
I20260812 06:15:47.274121 23144 tablet_service.cc:1467] Processing CreateTablet for tablet d4c77766d48647218045f60f6f69ccf7 (DEFAULT_TABLE table=test-table [id=d7a37c60b63a4bcd866e1327eda4b7eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:15:47.274536 23144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4c77766d48647218045f60f6f69ccf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:47.275869 23518 tablet_bootstrap.cc:492] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56: No bootstrap required, opened a new log
I20260812 06:15:47.276018 23518 ts_tablet_manager.cc:1397] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 06:15:47.278913 23524 tablet_bootstrap.cc:492] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd: Bootstrap starting.
I20260812 06:15:47.279495 23518 raft_consensus.cc:348] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59463ab3e95d445989da55a7ed2e3d56" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 43035 } } peers { permanent_uuid: "c777d859a0b64c409ee8b1c506ff0edd" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39403 } } peers { permanent_uuid: "26bad7eae5264088b74da32f3ed9a163" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36527 } }
I20260812 06:15:47.279762 23524 tablet_bootstrap.cc:654] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:47.279795 23518 raft_consensus.cc:374] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:47.279932 23518 raft_consensus.cc:729] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59463ab3e95d445989da55a7ed2e3d56, State: Initialized, Role: FOLLOWER
I20260812 06:15:47.280131 23524 log.cc:824] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:47.280143 23518 consensus_queue.cc:260] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59463ab3e95d445989da55a7ed2e3d56" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 43035 } } peers { permanent_uuid: "c777d859a0b64c409ee8b1c506ff0edd" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39403 } } peers { permanent_uuid: "26bad7eae5264088b74da32f3ed9a163" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36527 } }
I20260812 06:15:47.280586 23518 ts_tablet_manager.cc:1428] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 06:15:47.280646 23465 heartbeater.cc:503] Master 127.0.176.254:40299 was elected leader, sending a full tablet report...
I20260812 06:15:47.284265 23519 tablet_bootstrap.cc:492] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163: No bootstrap required, opened a new log
I20260812 06:15:47.284364 23519 ts_tablet_manager.cc:1397] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20260812 06:15:47.284669 23524 tablet_bootstrap.cc:492] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd: No bootstrap required, opened a new log
I20260812 06:15:47.284740 23524 ts_tablet_manager.cc:1397] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260812 06:15:47.287258 23519 raft_consensus.cc:348] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59463ab3e95d445989da55a7ed2e3d56" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 43035 } } peers { permanent_uuid: "c777d859a0b64c409ee8b1c506ff0edd" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39403 } } peers { permanent_uuid: "26bad7eae5264088b74da32f3ed9a163" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36527 } }
I20260812 06:15:47.287510 23519 raft_consensus.cc:374] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:47.287566 23519 raft_consensus.cc:729] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26bad7eae5264088b74da32f3ed9a163, State: Initialized, Role: FOLLOWER
I20260812 06:15:47.287741 23519 consensus_queue.cc:260] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59463ab3e95d445989da55a7ed2e3d56" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 43035 } } peers { permanent_uuid: "c777d859a0b64c409ee8b1c506ff0edd" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39403 } } peers { permanent_uuid: "26bad7eae5264088b74da32f3ed9a163" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36527 } }
I20260812 06:15:47.288079 23519 ts_tablet_manager.cc:1428] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 06:15:47.288215 23043 heartbeater.cc:503] Master 127.0.176.254:40299 was elected leader, sending a full tablet report...
I20260812 06:15:47.287384 23524 raft_consensus.cc:348] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59463ab3e95d445989da55a7ed2e3d56" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 43035 } } peers { permanent_uuid: "c777d859a0b64c409ee8b1c506ff0edd" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39403 } } peers { permanent_uuid: "26bad7eae5264088b74da32f3ed9a163" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36527 } }
I20260812 06:15:47.288445 23524 raft_consensus.cc:374] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:47.288527 23524 raft_consensus.cc:729] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c777d859a0b64c409ee8b1c506ff0edd, State: Initialized, Role: FOLLOWER
I20260812 06:15:47.288697 23524 consensus_queue.cc:260] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59463ab3e95d445989da55a7ed2e3d56" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 43035 } } peers { permanent_uuid: "c777d859a0b64c409ee8b1c506ff0edd" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39403 } } peers { permanent_uuid: "26bad7eae5264088b74da32f3ed9a163" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36527 } }
I20260812 06:15:47.289047 23524 ts_tablet_manager.cc:1428] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 06:15:47.289202 23254 heartbeater.cc:503] Master 127.0.176.254:40299 was elected leader, sending a full tablet report...
I20260812 06:15:47.352150 23530 raft_consensus.cc:482] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:15:47.352324 23530 raft_consensus.cc:504] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59463ab3e95d445989da55a7ed2e3d56" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 43035 } } peers { permanent_uuid: "c777d859a0b64c409ee8b1c506ff0edd" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39403 } } peers { permanent_uuid: "26bad7eae5264088b74da32f3ed9a163" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36527 } }
I20260812 06:15:47.353279 23530 leader_election.cc:288] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59463ab3e95d445989da55a7ed2e3d56 (127.0.176.195:43035), 26bad7eae5264088b74da32f3ed9a163 (127.0.176.193:36527)
I20260812 06:15:47.357293 23517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.353200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:33519 (local address 127.0.176.195:43035)
0812 06:15:47.353249 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:47.353252 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:47.353422 (+ 170us) server_negotiation.cc:407] Connection header received
0812 06:15:47.353559 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:47.353561 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:47.353570 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:47.353599 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:47.353883 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.354568 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.356044 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.356800 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.356853 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:47.356863 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:47.357175 (+ 312us) server_negotiation.cc:299] Negotiation successful
0812 06:15:47.357221 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:15:47.357308 23509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.353212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:50383 (local address 127.0.176.193:36527)
0812 06:15:47.353257 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:47.353260 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:47.353487 (+ 227us) server_negotiation.cc:407] Connection header received
0812 06:15:47.353588 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:47.353589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:47.353599 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:47.353627 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:47.353851 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.354778 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.356142 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.356883 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.356936 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:47.356948 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:47.357192 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 06:15:47.357238 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:15:47.357717 23532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.352984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:36527 (local address 127.0.176.194:50383)
0812 06:15:47.353419 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:47.353430 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:47.353514 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:47.353695 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:47.353696 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:47.353698 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:47.353777 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:47.353779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.354893 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.354894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:47.356027 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:47.356030 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.357032 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.357033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:47.357111 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:47.357115 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:15:47.357544 (+ 429us) client_negotiation.cc:240] Negotiation successful
0812 06:15:47.357609 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":121,"threads_started":1}
I20260812 06:15:47.358042 23531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.352973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:43035 (local address 127.0.176.194:33519)
0812 06:15:47.353315 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:47.353328 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:47.353478 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:47.353666 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:47.353667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:47.353669 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:47.353763 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:47.353765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.354670 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.354671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:47.355928 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:47.355932 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.356929 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.356930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:47.357000 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:47.357004 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:15:47.357908 (+ 904us) client_negotiation.cc:240] Negotiation successful
0812 06:15:47.357961 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":115,"threads_started":1}
I20260812 06:15:47.358155 22957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4c77766d48647218045f60f6f69ccf7" candidate_uuid: "c777d859a0b64c409ee8b1c506ff0edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26bad7eae5264088b74da32f3ed9a163" is_pre_election: true
I20260812 06:15:47.358340 22957 raft_consensus.cc:2454] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c777d859a0b64c409ee8b1c506ff0edd in term 0.
I20260812 06:15:47.358471 23395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4c77766d48647218045f60f6f69ccf7" candidate_uuid: "c777d859a0b64c409ee8b1c506ff0edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59463ab3e95d445989da55a7ed2e3d56" is_pre_election: true
I20260812 06:15:47.358624 23395 raft_consensus.cc:2454] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c777d859a0b64c409ee8b1c506ff0edd in term 0.
I20260812 06:15:47.358656 23073 leader_election.cc:302] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26bad7eae5264088b74da32f3ed9a163, c777d859a0b64c409ee8b1c506ff0edd; no voters:
I20260812 06:15:47.358894 23530 raft_consensus.cc:2781] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:15:47.358994 23530 raft_consensus.cc:482] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:15:47.359032 23530 raft_consensus.cc:3037] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:47.360163 23530 raft_consensus.cc:504] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59463ab3e95d445989da55a7ed2e3d56" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 43035 } } peers { permanent_uuid: "c777d859a0b64c409ee8b1c506ff0edd" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39403 } } peers { permanent_uuid: "26bad7eae5264088b74da32f3ed9a163" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36527 } }
I20260812 06:15:47.360483 23395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4c77766d48647218045f60f6f69ccf7" candidate_uuid: "c777d859a0b64c409ee8b1c506ff0edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59463ab3e95d445989da55a7ed2e3d56"
I20260812 06:15:47.360569 23395 raft_consensus.cc:3037] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:47.361539 23395 raft_consensus.cc:2454] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c777d859a0b64c409ee8b1c506ff0edd in term 1.
I20260812 06:15:47.361793 23075 leader_election.cc:302] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59463ab3e95d445989da55a7ed2e3d56, c777d859a0b64c409ee8b1c506ff0edd; no voters:
I20260812 06:15:47.362190 22957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4c77766d48647218045f60f6f69ccf7" candidate_uuid: "c777d859a0b64c409ee8b1c506ff0edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26bad7eae5264088b74da32f3ed9a163"
I20260812 06:15:47.362283 22957 raft_consensus.cc:3037] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:47.363250 22957 raft_consensus.cc:2454] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c777d859a0b64c409ee8b1c506ff0edd in term 1.
I20260812 06:15:47.363552 23530 leader_election.cc:288] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [CANDIDATE]: Term 1 election: Requested vote from peers 59463ab3e95d445989da55a7ed2e3d56 (127.0.176.195:43035), 26bad7eae5264088b74da32f3ed9a163 (127.0.176.193:36527)
I20260812 06:15:47.363632 23530 raft_consensus.cc:2781] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:15:47.363675 23530 raft_consensus.cc:686] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [term 1 LEADER]: Becoming Leader. State: Replica: c777d859a0b64c409ee8b1c506ff0edd, State: Running, Role: LEADER
I20260812 06:15:47.363771 23530 consensus_queue.cc:237] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59463ab3e95d445989da55a7ed2e3d56" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 43035 } } peers { permanent_uuid: "c777d859a0b64c409ee8b1c506ff0edd" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39403 } } peers { permanent_uuid: "26bad7eae5264088b74da32f3ed9a163" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36527 } }
I20260812 06:15:47.364790 22697 catalog_manager.cc:5495] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd reported cstate change: term changed from 0 to 1, leader changed from <none> to c777d859a0b64c409ee8b1c506ff0edd (127.0.176.194). New cstate: current_term: 1 leader_uuid: "c777d859a0b64c409ee8b1c506ff0edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59463ab3e95d445989da55a7ed2e3d56" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c777d859a0b64c409ee8b1c506ff0edd" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26bad7eae5264088b74da32f3ed9a163" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36527 } health_report { overall_health: UNKNOWN } } }
I20260812 06:15:47.384879 23516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.370723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35510 (local address 127.0.176.194:39403)
0812 06:15:47.370764 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:47.370766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:47.370779 (+ 13us) server_negotiation.cc:407] Connection header received
0812 06:15:47.381215 (+ 10436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:47.381217 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:47.381253 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:47.381387 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:15:47.381645 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.382400 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.383582 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:47.383886 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:47.383983 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:47.384232 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:15:47.384388 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:15:47.384467 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:47.384759 (+ 292us) server_negotiation.cc:299] Negotiation successful
0812 06:15:47.384789 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:15:47.387269 22957 raft_consensus.cc:1261] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163 [term 1 FOLLOWER]: Refusing update from remote peer c777d859a0b64c409ee8b1c506ff0edd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:15:47.387743 23533 consensus_queue.cc:1035] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "26bad7eae5264088b74da32f3ed9a163" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:15:47.388051 23395 raft_consensus.cc:1261] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56 [term 1 FOLLOWER]: Refusing update from remote peer c777d859a0b64c409ee8b1c506ff0edd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:15:47.388865 23533 consensus_queue.cc:1035] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "59463ab3e95d445989da55a7ed2e3d56" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:15:47.394495 23538 mvcc.cc:205] Tried to move back new op lower bound from 7317566862894895104 to 7317566862802808832. Current Snapshot: MvccSnapshot[applied={T|T < 7317566862894895104}]
I20260812 06:15:47.395154 23542 mvcc.cc:205] Tried to move back new op lower bound from 7317566862894895104 to 7317566862802808832. Current Snapshot: MvccSnapshot[applied={T|T < 7317566862894895104}]
I20260812 06:15:47.400961 23540 mvcc.cc:205] Tried to move back new op lower bound from 7317566862894895104 to 7317566862802808832. Current Snapshot: MvccSnapshot[applied={T|T < 7317566862894895104}]
I20260812 06:15:47.401932 22696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:15:47.402043 22696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:15:47.402782 22696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eafeaac17fe94e93a47b461adae1ec11: Sending DeleteTablet for 3 replicas of tablet d4c77766d48647218045f60f6f69ccf7
I20260812 06:15:47.403139 23144 tablet_service.cc:1514] Processing DeleteTablet for tablet d4c77766d48647218045f60f6f69ccf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:15:47 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:35502
I20260812 06:15:47.403313 22900 tablet_service.cc:1514] Processing DeleteTablet for tablet d4c77766d48647218045f60f6f69ccf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:15:47 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:48972
I20260812 06:15:47.403442 23327 tablet_service.cc:1514] Processing DeleteTablet for tablet d4c77766d48647218045f60f6f69ccf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:15:47 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:56296
I20260812 06:15:47.403800 23556 tablet_replica.cc:330] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163: stopping tablet replica
I20260812 06:15:47.403909 23556 raft_consensus.cc:2229] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:15:47.403921 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 22767
I20260812 06:15:47.404011 23556 raft_consensus.cc:2258] T d4c77766d48647218045f60f6f69ccf7 P 26bad7eae5264088b74da32f3ed9a163 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 06:15:47.428205 22677 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:36527 (error 108)
I20260812 06:15:47.428586 23555 tablet_replica.cc:330] T d4c77766d48647218045f60f6f69ccf7 P c777d859a0b64c409ee8b1c506ff0edd: stopping tablet replica
I20260812 06:15:47.428803 23558 tablet_replica.cc:330] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56: stopping tablet replica
I20260812 06:15:47.429028 23558 raft_consensus.cc:2229] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:15:47.429302 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 23051
I20260812 06:15:47.429343 23511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.429138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:36527 (local address 127.0.0.1:48978)
0812 06:15:47.429246 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:47.429303 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:36527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260812 06:15:47.444969 23558 raft_consensus.cc:2258] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:15:47.447887 23558 ts_tablet_manager.cc:1905] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:15:47.449663 23558 ts_tablet_manager.cc:1918] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:15:47.449746 23558 log.cc:1196] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/d4c77766d48647218045f60f6f69ccf7
I20260812 06:15:47.450007 23558 ts_tablet_manager.cc:1939] T d4c77766d48647218045f60f6f69ccf7 P 59463ab3e95d445989da55a7ed2e3d56: Deleting consensus metadata
I20260812 06:15:47.450695 22678 catalog_manager.cc:4841] TS 59463ab3e95d445989da55a7ed2e3d56 (127.0.176.195:43035): tablet d4c77766d48647218045f60f6f69ccf7 (table test-table [id=d7a37c60b63a4bcd866e1327eda4b7eb]) successfully deleted
W20260812 06:15:47.457918 22677 catalog_manager.cc:4584] TS 26bad7eae5264088b74da32f3ed9a163 (127.0.176.193:36527): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d4c77766d48647218045f60f6f69ccf7: Network error: Client connection negotiation failed: client connection to 127.0.176.193:36527: connect: Connection refused (error 111)
I20260812 06:15:47.463253 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 23257
I20260812 06:15:47.472219 23511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:47.472079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:39403 (local address 127.0.0.1:35518)
0812 06:15:47.472139 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:47.472172 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.194:39403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 06:15:47.477083 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 22651
I20260812 06:15:47.496600 707 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 06:15:47.844352 707 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 06:15:47.844487 707 mini_ranger.cc:66] Stopping Ranger...
I20260812 06:15:48.200342 707 mini_ranger.cc:68] Stopped Ranger
2026-08-12 06:15:48.200 UTC [21080] LOG: received smart shutdown request
2026-08-12 06:15:48.205 UTC [21080] LOG: background worker "logical replication launcher" (PID 21092) exited with exit code 1
2026-08-12 06:15:48.205 UTC [21085] LOG: shutting down
2026-08-12 06:15:48.377 UTC [21080] LOG: database system is shut down
2026-08-12T06:15:48Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (53667 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:15:48 dist-test-slave-gw5c krb5kdc[23570](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:15:48 dist-test-slave-gw5c krb5kdc[23570](info): set up 2 sockets
Aug 12 06:15:48 dist-test-slave-gw5c krb5kdc[23570](info): commencing operation
krb5kdc: starting...
W20260812 06:15:49.798759 707 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:15:49 dist-test-slave-gw5c krb5kdc[23570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:15:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:15:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:15:49.930500 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43155
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:37165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:43155,127.0.176.253:41239,127.0.176.252:43931
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:50.016247 23587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:50.016541 23587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:50.016584 23587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:50.017846 23587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:15:50.017938 23587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:50.017963 23587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:50.017993 23587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:15:50.018026 23587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:15:50.019711 23587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:37165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:43155,127.0.176.253:41239,127.0.176.252:43931
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:50.020028 23587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:50.020304 23587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:50.025434 23598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:50.025650 23595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:50.025432 23596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:50.025771 23587 server_base.cc:1034] running on GCE node
I20260812 06:15:50.026039 23587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:50.026461 23587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:50.027710 23587 hybrid_clock.cc:648] HybridClock initialized: now 1786515350027679 us; error 37 us; skew 500 ppm
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:50.030417 23587 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:15:50.030859 23587 webserver.cc:460] Webserver started at http://127.0.176.254:43455/ using document root <none> and password file <none>
I20260812 06:15:50.031054 23587 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:50.031096 23587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:50.031190 23587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:15:50.032347 23587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "13227f7c68c041e091ac311c019ea26b"
format_stamp: "Formatted at 2026-08-12 06:15:50 on dist-test-slave-gw5c"
server_key: "2f2c920d886beb06b70f00e223f03c00"
server_key_iv: "26a46407c65c9bd56b70df98ae8908eb"
server_key_version: "encryptionkey@0"
I20260812 06:15:50.032680 23587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "13227f7c68c041e091ac311c019ea26b"
format_stamp: "Formatted at 2026-08-12 06:15:50 on dist-test-slave-gw5c"
server_key: "2f2c920d886beb06b70f00e223f03c00"
server_key_iv: "26a46407c65c9bd56b70df98ae8908eb"
server_key_version: "encryptionkey@0"
I20260812 06:15:50.034031 23587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:15:50.034758 23611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:50.034919 23587 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:15:50.035017 23587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "13227f7c68c041e091ac311c019ea26b"
format_stamp: "Formatted at 2026-08-12 06:15:50 on dist-test-slave-gw5c"
server_key: "2f2c920d886beb06b70f00e223f03c00"
server_key_iv: "26a46407c65c9bd56b70df98ae8908eb"
server_key_version: "encryptionkey@0"
I20260812 06:15:50.035076 23587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:50.051257 23587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:50.053613 23587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:50.053747 23587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:50.058122 23587 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:43155
I20260812 06:15:50.058178 23689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:43155 every 8 connection(s)
I20260812 06:15:50.058557 23587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:15:50.059650 23690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:50.061322 23690 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:15:50.067108 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 23587
I20260812 06:15:50.067284 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:15:50.067504 707 external_mini_cluster.cc:1428] Setting key 0506b827a241c12c9d252ac809da162a
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:50.072731 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.062215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43155 (local address 127.0.0.1:41292)
0812 06:15:50.062439 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.062486 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:50.063034 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:50.063340 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:50.063351 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:50.063693 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:50.063864 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.063869 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.065402 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.065404 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.066118 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.066120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.066752 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.066754 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.066840 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.067594 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:50.067606 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:50.069093 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:50.071081 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.071088 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.071090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.071297 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.071591 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.071591 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.071592 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.071681 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.072070 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:50.072076 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:50.072140 (+ 64us) client_negotiation.cc:769] Sending connection context
0812 06:15:50.072252 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 06:15:50.072515 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":102,"spinlock_wait_cycles":10112,"thread_start_us":117,"threads_started":1}
I20260812 06:15:50.072731 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.062228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41292 (local address 127.0.176.254:43155)
0812 06:15:50.062452 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.062461 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.062596 (+ 135us) server_negotiation.cc:407] Connection header received
0812 06:15:50.063203 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.063206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.063232 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.063336 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.063969 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.065257 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.066231 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.066579 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.066798 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.069195 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.069203 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.069204 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.069211 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.070951 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.071417 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.071421 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.071421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.071518 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.071749 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.071749 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.071750 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.071997 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.072096 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.072279 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.072445 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":104,"threads_started":1}
I20260812 06:15:50.073799 23690 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:15:50.074188 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.074058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:41239 (local address 127.0.0.1:54084)
0812 06:15:50.074111 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.074161 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:41239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 06:15:50.074364 23614 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.176.253:41239: connect: Connection refused (error 111)
I20260812 06:15:50.074990 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.074890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:41239 (local address 127.0.0.1:54100)
0812 06:15:50.074939 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.074967 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:41239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 06:15:50.075121 23690 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.253:41239: Network error: Client connection negotiation failed: client connection to 127.0.176.253:41239: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.0.176.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.253.keytab.
Entry for principal kudu/127.0.176.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.253.keytab.
I20260812 06:15:50.097771 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.253:41239
--webserver_interface=127.0.176.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.253.keytab
--principal=kudu/127.0.176.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:37165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:43155,127.0.176.253:41239,127.0.176.252:43931
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:15:50.124392 23690 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } attempt: 1
I20260812 06:15:50.125012 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.124854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:41239 (local address 127.0.0.1:54112)
0812 06:15:50.124926 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.124980 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:41239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 06:15:50.125481 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.125355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:41239 (local address 127.0.0.1:54122)
0812 06:15:50.125422 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.125456 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:41239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 06:15:50.125625 23690 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.253:41239: Network error: Client connection negotiation failed: client connection to 127.0.176.253:41239: connect: Connection refused (error 111)
W20260812 06:15:50.186815 23698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:50.187070 23698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:50.187098 23698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:50.188277 23698 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:15:50.188323 23698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:50.188336 23698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:50.188349 23698 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:15:50.188361 23698 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:15:50.189975 23698 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:37165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:43155,127.0.176.253:41239,127.0.176.252:43931
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.253.keytab
--principal=kudu/127.0.176.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.253:41239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.176.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:50.190215 23698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:50.190423 23698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:15:50.193825 23690 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } attempt: 2
I20260812 06:15:50.194361 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.194214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:41239 (local address 127.0.0.1:54126)
0812 06:15:50.194282 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.194320 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:41239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 06:15:50.194957 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.194714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:41239 (local address 127.0.0.1:54128)
0812 06:15:50.194887 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.194926 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:41239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
W20260812 06:15:50.195070 23690 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.253:41239: Network error: Client connection negotiation failed: client connection to 127.0.176.253:41239: connect: Connection refused (error 111)
W20260812 06:15:50.195648 23712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:50.195652 23706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:50.195648 23708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:50.196005 23698 server_base.cc:1034] running on GCE node
I20260812 06:15:50.196300 23698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:50.196669 23698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:50.197878 23698 hybrid_clock.cc:648] HybridClock initialized: now 1786515350197866 us; error 46 us; skew 500 ppm
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:50.201287 23698 init.cc:377] Logged in from keytab as kudu/127.0.176.253@KRBTEST.COM (short username kudu)
I20260812 06:15:50.201792 23698 webserver.cc:460] Webserver started at http://127.0.176.253:40149/ using document root <none> and password file <none>
I20260812 06:15:50.202030 23698 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:50.202102 23698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:50.202265 23698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:15:50.203465 23698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/data/instance:
uuid: "95d3d22a85de42a5a8138b51c703c9aa"
format_stamp: "Formatted at 2026-08-12 06:15:50 on dist-test-slave-gw5c"
server_key: "0fd6f33e58e88b9bef24ac3ba1aee97f"
server_key_iv: "94279dacd8f3632e88b7ddf9bfd5a711"
server_key_version: "encryptionkey@0"
I20260812 06:15:50.203873 23698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/wal/instance:
uuid: "95d3d22a85de42a5a8138b51c703c9aa"
format_stamp: "Formatted at 2026-08-12 06:15:50 on dist-test-slave-gw5c"
server_key: "0fd6f33e58e88b9bef24ac3ba1aee97f"
server_key_iv: "94279dacd8f3632e88b7ddf9bfd5a711"
server_key_version: "encryptionkey@0"
I20260812 06:15:50.205351 23698 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:15:50.206180 23725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:50.206362 23698 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:50.206480 23698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/wal
uuid: "95d3d22a85de42a5a8138b51c703c9aa"
format_stamp: "Formatted at 2026-08-12 06:15:50 on dist-test-slave-gw5c"
server_key: "0fd6f33e58e88b9bef24ac3ba1aee97f"
server_key_iv: "94279dacd8f3632e88b7ddf9bfd5a711"
server_key_version: "encryptionkey@0"
I20260812 06:15:50.206563 23698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:50.218065 23698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:50.220619 23698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:50.220803 23698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:50.225533 23698 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.253:41239
I20260812 06:15:50.225570 23801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.253:41239 every 8 connection(s)
I20260812 06:15:50.226066 23698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/data/info.pb
I20260812 06:15:50.227093 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:50.228842 23803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:15:50.234407 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 23698
I20260812 06:15:50.234560 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-1/wal/instance
I20260812 06:15:50.234750 707 external_mini_cluster.cc:1428] Setting key 25fcd91472c2a1b1c50e86118b84c355
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.253@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:50.238785 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.229658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41300 (local address 127.0.176.254:43155)
0812 06:15:50.229724 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.229726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.229931 (+ 205us) server_negotiation.cc:407] Connection header received
0812 06:15:50.230385 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.230386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.230395 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.230486 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.231142 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.231729 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.232747 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.232963 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.233032 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.235581 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.235583 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.235584 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.235593 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.237110 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.237666 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.237666 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.237667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.237719 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.238042 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.238043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.238043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.238201 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.238273 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.238539 (+ 266us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.238643 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:15:50.238812 23806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.229624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43155 (local address 127.0.0.1:41300)
0812 06:15:50.229801 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.229847 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:50.230299 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:50.230548 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:50.230551 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:50.230813 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:50.231026 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.231030 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.231818 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.231819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.232625 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.232628 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.233048 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.233049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.233155 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.233744 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:50.233763 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:50.235479 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:50.237203 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.237212 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.237215 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.237583 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.237821 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.237822 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.237822 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.237981 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.238269 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:50.238274 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:50.238410 (+ 136us) client_negotiation.cc:769] Sending connection context
0812 06:15:50.238498 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 06:15:50.238635 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":97,"threads_started":1}
I20260812 06:15:50.239507 23803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.0.176.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.252@KRBTEST.COM" created.
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.253@KRBTEST.COM for kudu/127.0.176.253@KRBTEST.COM
I20260812 06:15:50.250540 23806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.239853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:41239 (local address 127.0.0.1:54144)
0812 06:15:50.239888 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.239900 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:50.239937 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:50.240279 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:50.240280 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:50.240443 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:50.240497 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.240499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.241446 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.241447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.242300 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.242303 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.243007 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.243008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.243067 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.243587 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:50.243592 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:50.247567 (+ 3975us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:50.249460 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.249461 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.249461 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.249632 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.249862 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.249863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.249864 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.249931 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.250275 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:50.250276 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:50.250320 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 06:15:50.250386 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 06:15:50.250469 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260812 06:15:50.250705 23809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.239949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54144 (local address 127.0.176.253:41239)
0812 06:15:50.240140 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.240144 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.240162 (+ 18us) server_negotiation.cc:407] Connection header received
0812 06:15:50.240179 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.240180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.240191 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.240279 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.240582 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.241344 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.242405 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.242916 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.243004 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.247701 (+ 4697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.247715 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.247716 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.247725 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.249343 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.249729 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.249732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.249732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.249794 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.249994 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.249995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.249996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.250194 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.250283 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.250448 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.250544 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":118,"threads_started":1}
I20260812 06:15:50.251313 23803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:15:50.251754 23806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.251623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:43931 (local address 127.0.0.1:52418)
0812 06:15:50.251677 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.251724 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 06:15:50.251924 23727 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
I20260812 06:15:50.252398 23806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.252305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:43931 (local address 127.0.0.1:52426)
0812 06:15:50.252349 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.252373 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 06:15:50.252526 23803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:43931: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.252.keytab.
Entry for principal kudu/127.0.176.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.252.keytab.
I20260812 06:15:50.262872 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.252:43931
--webserver_interface=127.0.176.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.252.keytab
--principal=kudu/127.0.176.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:37165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:43155,127.0.176.253:41239,127.0.176.252:43931
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:15:50.286260 23690 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } attempt: 3
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for kudu/127.0.176.253@KRBTEST.COM
I20260812 06:15:50.294097 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.286684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:41239 (local address 127.0.0.1:54150)
0812 06:15:50.286760 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.286775 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:50.286832 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:50.287043 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:50.287044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:50.287245 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:50.287326 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.287328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.288314 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.288315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.288832 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.288834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.289323 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.289324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.289391 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.289899 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:50.289904 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:50.291358 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:50.293116 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.293117 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.293118 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.293287 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.293503 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.293504 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.293504 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.293557 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.293848 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:50.293849 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:50.293888 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 06:15:50.293938 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:15:50.294022 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 06:15:50.294189 23809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.286802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54150 (local address 127.0.176.253:41239)
0812 06:15:50.286878 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.286880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.286891 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:15:50.286924 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.286925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.286940 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.287027 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.287437 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.288224 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.288926 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.289245 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.289319 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.291505 (+ 2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.291506 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.291507 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.291515 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.293023 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.293356 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.293357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.293357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.293433 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.293624 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.293625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.293625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.293782 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.293856 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.293963 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.294056 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:15:50.294976 23690 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:15:50.295356 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.295238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:43931 (local address 127.0.0.1:52436)
0812 06:15:50.295292 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.295323 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 06:15:50.295734 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.295643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:43931 (local address 127.0.0.1:52442)
0812 06:15:50.295686 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.295711 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 06:15:50.295862 23690 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:43931: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
I20260812 06:15:50.301788 23803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } attempt: 1
I20260812 06:15:50.302310 23806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.302155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:43931 (local address 127.0.0.1:52450)
0812 06:15:50.302224 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.302273 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 06:15:50.302696 23806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.302603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:43931 (local address 127.0.0.1:52460)
0812 06:15:50.302648 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.302676 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 06:15:50.302794 23803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:43931: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
I20260812 06:15:50.327042 23690 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } attempt: 1
I20260812 06:15:50.327721 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.327559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:43931 (local address 127.0.0.1:52474)
0812 06:15:50.327643 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.327690 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 06:15:50.328158 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.328040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:43931 (local address 127.0.0.1:52478)
0812 06:15:50.328094 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.328128 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 06:15:50.328298 23690 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:43931: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
W20260812 06:15:50.352140 23813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:50.352350 23813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:50.352372 23813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:50.353500 23813 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:15:50.353545 23813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:50.353559 23813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:50.353572 23813 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:15:50.353609 23813 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:15:50.355154 23813 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:37165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:43155,127.0.176.253:41239,127.0.176.252:43931
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.252.keytab
--principal=kudu/127.0.176.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.252:43931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.176.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:50.355468 23813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:50.355711 23813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:50.360947 23823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:50.360922 23813 server_base.cc:1034] running on GCE node
W20260812 06:15:50.360924 23822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:50.361052 23825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:50.361418 23813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:50.361729 23813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:50.362905 23813 hybrid_clock.cc:648] HybridClock initialized: now 1786515350362889 us; error 42 us; skew 500 ppm
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:50.365447 23813 init.cc:377] Logged in from keytab as kudu/127.0.176.252@KRBTEST.COM (short username kudu)
I20260812 06:15:50.365958 23813 webserver.cc:460] Webserver started at http://127.0.176.252:43961/ using document root <none> and password file <none>
I20260812 06:15:50.366194 23813 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:50.366264 23813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:50.366432 23813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:15:50.367635 23813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/data/instance:
uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa"
format_stamp: "Formatted at 2026-08-12 06:15:50 on dist-test-slave-gw5c"
server_key: "e67afdb1d724eacece182a6fea23a16d"
server_key_iv: "8cd296e946834bfc4be90988599a092b"
server_key_version: "encryptionkey@0"
I20260812 06:15:50.368023 23813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/wal/instance:
uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa"
format_stamp: "Formatted at 2026-08-12 06:15:50 on dist-test-slave-gw5c"
server_key: "e67afdb1d724eacece182a6fea23a16d"
server_key_iv: "8cd296e946834bfc4be90988599a092b"
server_key_version: "encryptionkey@0"
I20260812 06:15:50.369513 23813 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:15:50.370329 23842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:50.370537 23813 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:50.370646 23813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/wal
uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa"
format_stamp: "Formatted at 2026-08-12 06:15:50 on dist-test-slave-gw5c"
server_key: "e67afdb1d724eacece182a6fea23a16d"
server_key_iv: "8cd296e946834bfc4be90988599a092b"
server_key_version: "encryptionkey@0"
I20260812 06:15:50.370721 23813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:50.370922 23803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } attempt: 2
I20260812 06:15:50.371433 23806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.371255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:43931 (local address 127.0.0.1:52486)
0812 06:15:50.371340 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.371374 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 06:15:50.372184 23806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.372075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:43931 (local address 127.0.0.1:52498)
0812 06:15:50.372125 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.372150 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 06:15:50.372273 23803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:43931: Network error: Client connection negotiation failed: client connection to 127.0.176.252:43931: connect: Connection refused (error 111)
I20260812 06:15:50.390861 23813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:50.396072 23813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:50.396307 23813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:50.402484 23813 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.252:43931
I20260812 06:15:50.402540 23916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.252:43931 every 8 connection(s)
I20260812 06:15:50.403029 23813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/data/info.pb
I20260812 06:15:50.403451 23690 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } attempt: 2
I20260812 06:15:50.404270 23917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:50.406601 23917 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:15:50.409269 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 23813
I20260812 06:15:50.409418 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515178947866-707-0/minicluster-data/master-2/wal/instance
I20260812 06:15:50.409689 707 external_mini_cluster.cc:1428] Setting key cc50d79bfd0ec0e4e4320045c0098b47
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for kudu/127.0.176.252@KRBTEST.COM
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.252@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.252@KRBTEST.COM
I20260812 06:15:50.417766 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.403832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:43931 (local address 127.0.0.1:52506)
0812 06:15:50.403891 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.403906 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:50.403979 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:50.405175 (+ 1196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:50.405177 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:50.405412 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:50.405476 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.405479 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.407894 (+ 2415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.407896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.408677 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.408681 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.409700 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.409701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.409777 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.410538 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:50.410545 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:50.412070 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:50.416113 (+ 4043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.416114 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.416115 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.416383 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.416702 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.416703 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.416703 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.416772 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.417320 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:50.417321 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:50.417387 (+ 66us) client_negotiation.cc:769] Sending connection context
0812 06:15:50.417537 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 06:15:50.417653 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 06:15:50.418174 23919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.404003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52506 (local address 127.0.176.252:43931)
0812 06:15:50.404222 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.404232 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.404268 (+ 36us) server_negotiation.cc:407] Connection header received
0812 06:15:50.404930 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.404938 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.405011 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.405166 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.405637 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.407749 (+ 2112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.408806 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.409600 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.409731 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.412409 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.412436 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.412436 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.412465 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.416010 (+ 3545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.416473 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.416477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.416478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.416613 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.416854 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.416856 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.416856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.417246 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.417329 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.417627 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.417762 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":111,"threads_started":1}
I20260812 06:15:50.418637 23923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.407258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43155 (local address 127.0.0.1:41316)
0812 06:15:50.408068 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.408114 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:50.408198 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:50.408366 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:50.408368 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:50.408764 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:50.408861 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.408863 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.409959 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.409959 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.410941 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.410946 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.411615 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.411616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.411696 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.412571 (+ 875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:50.412585 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:50.414632 (+ 2047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:50.416587 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.416593 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.416595 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.416863 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.417049 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.417050 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.417050 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.417113 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.418299 (+ 1186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:50.418303 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:50.418358 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 06:15:50.418452 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 06:15:50.418568 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":777,"thread_start_us":626,"threads_started":1}
I20260812 06:15:50.418712 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.407958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41316 (local address 127.0.176.254:43155)
0812 06:15:50.408011 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.408012 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.408201 (+ 189us) server_negotiation.cc:407] Connection header received
0812 06:15:50.408276 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.408277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.408288 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.408333 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.408957 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.409686 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.411069 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.411433 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.411488 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.414717 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.414719 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.414719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.414726 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.416504 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.416929 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.416930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.416930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.416977 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.417232 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.417233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.417234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.417483 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.417555 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.418507 (+ 952us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.418604 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:15:50.419243 23917 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:15:50.420976 23926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.410127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52520 (local address 127.0.176.252:43931)
0812 06:15:50.410282 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.410284 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.410443 (+ 159us) server_negotiation.cc:407] Connection header received
0812 06:15:50.410576 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.410577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.410590 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.410671 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.411546 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.412848 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.413987 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.414303 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.414381 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.417213 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.417215 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.417216 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.417223 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.419748 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.420134 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.420135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.420136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.420192 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.420399 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.420400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.420400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.420516 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.420683 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.420723 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.420805 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":80,"threads_started":1}
I20260812 06:15:50.421002 23690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b: Bootstrap starting.
I20260812 06:15:50.421845 23690 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:50.422179 23690 log.cc:824] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:50.423133 23690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b: No bootstrap required, opened a new log
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.252@KRBTEST.COM for kudu/127.0.176.253@KRBTEST.COM
I20260812 06:15:50.425495 23690 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } }
I20260812 06:15:50.425658 23690 raft_consensus.cc:374] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:50.425709 23690 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13227f7c68c041e091ac311c019ea26b, State: Initialized, Role: FOLLOWER
I20260812 06:15:50.425873 23690 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } }
I20260812 06:15:50.426416 23928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } } }
I20260812 06:15:50.427199 23928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:15:50.426479 23690 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [sys.catalog]: configured and running, proceeding with master startup.
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:50.428586 23809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.419638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54156 (local address 127.0.176.253:41239)
0812 06:15:50.419721 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.419724 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.419735 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:15:50.419801 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.419802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.419814 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.419869 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.420185 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.420928 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.422195 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.422491 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.422547 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.425100 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.425102 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.425102 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.425113 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.426946 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.427516 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.427519 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.427519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.427679 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.428023 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.428024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.428025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.428153 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.428232 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.428399 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.428486 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 06:15:50.428586 23923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.419550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:41239 (local address 127.0.0.1:54156)
0812 06:15:50.419689 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.419701 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:50.419745 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:50.419875 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:50.419877 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:50.420028 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:50.420076 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.420078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.421276 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.421277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.422081 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.422084 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.422617 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.422618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.422662 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.423119 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:50.423124 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:50.424943 (+ 1819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:50.427066 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.427067 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.427068 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.427323 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.427872 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.427875 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.427876 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.427954 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.428235 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:50.428237 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:50.428282 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 06:15:50.428371 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 06:15:50.428486 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119}
W20260812 06:15:50.429302 23944 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:15:50.429386 23944 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:15:50.429769 23917 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:15:50.430370 23587 master_runner.cc:186] Error getting master registration for 127.0.176.253:41239: OK, instance_id { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" instance_seqno: 1786515350224150 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:15:50.432919 23587 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.252@KRBTEST.COM for kudu/127.0.176.252@KRBTEST.COM
I20260812 06:15:50.437731 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.421622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41318 (local address 127.0.176.254:43155)
0812 06:15:50.421663 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.421665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.421708 (+ 43us) server_negotiation.cc:407] Connection header received
0812 06:15:50.421780 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.421781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.421790 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.421846 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.422522 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.423239 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.424186 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.424468 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.424547 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.428259 (+ 3712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.428260 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.428261 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.428267 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.436360 (+ 8093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.436777 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.436779 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.436779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.436843 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.437083 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.437084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.437084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.437202 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.437400 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.437540 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.437624 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:15:50.440796 23923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.430030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:43931 (local address 127.0.0.1:52524)
0812 06:15:50.430136 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.430146 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:50.430202 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:50.430348 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:50.430349 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:50.433154 (+ 2805us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:50.433205 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.433208 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.433920 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.433921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.434714 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.434717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.435093 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.435094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.435152 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.436002 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:50.436007 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:50.437589 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:50.439530 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.439531 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.439531 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.439750 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.439964 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.439965 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.439965 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.440031 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.440390 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:50.440391 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:50.440462 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 06:15:50.440552 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 06:15:50.440661 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98}
I20260812 06:15:50.440891 23926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.430076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52524 (local address 127.0.176.252:43931)
0812 06:15:50.430117 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.430119 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.430181 (+ 62us) server_negotiation.cc:407] Connection header received
0812 06:15:50.430261 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.430261 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.430271 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.430297 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.433356 (+ 3059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.433831 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.434802 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.435013 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.435067 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.437715 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.437717 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.437717 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.437726 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.439452 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.439826 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.439827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.439827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.439887 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.440101 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.440102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.440102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.440303 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.440377 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.440590 (+ 213us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.440728 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":22}
I20260812 06:15:50.442559 23917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa: Bootstrap starting.
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.253@KRBTEST.COM
I20260812 06:15:50.443333 23917 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:50.443735 23917 log.cc:824] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:50.444630 23917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa: No bootstrap required, opened a new log
I20260812 06:15:50.446792 23809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.438475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54162 (local address 127.0.176.253:41239)
0812 06:15:50.438520 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.438522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.438530 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:15:50.438554 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.438555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.438564 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.438621 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.439283 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.439903 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.440811 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.441105 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.441173 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.443809 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.443811 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.443812 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.443821 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.445563 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.445975 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.445976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.445976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.446042 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.446261 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.446262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.446262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.446403 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.446575 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.446621 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.446705 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:15:50.446825 23917 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } }
I20260812 06:15:50.447003 23917 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:50.447050 23917 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb927cc237a44ac2a7e4aee40d1f8bfa, State: Initialized, Role: FOLLOWER
I20260812 06:15:50.447201 23917 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } }
I20260812 06:15:50.447572 23917 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:15:50.448580 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:15:50.449021 23952 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } } }
I20260812 06:15:50.450134 23952 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:15:50.449723 23972 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:15:50.450325 23972 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:15:50.451785 23813 master_runner.cc:186] Error getting master registration for 127.0.176.253:41239: OK, instance_id { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" instance_seqno: 1786515350224150 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:15:50.454071 23813 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:15:50.463528 23803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } attempt: 3
I20260812 06:15:50.463733 23809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.454900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54176 (local address 127.0.176.253:41239)
0812 06:15:50.454944 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.454945 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.455924 (+ 979us) server_negotiation.cc:407] Connection header received
0812 06:15:50.456049 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.456050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.456061 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.456094 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.456867 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.457582 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.458581 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.458871 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.458915 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.460497 (+ 1582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.460498 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.460499 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.460506 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.462165 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.462580 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.462581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.462582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.462638 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.462885 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.462886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.462886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.463019 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.463094 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.463549 (+ 455us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.463635 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:15:50.464103 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.454487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41320 (local address 127.0.176.254:43155)
0812 06:15:50.454534 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.454537 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.454858 (+ 321us) server_negotiation.cc:407] Connection header received
0812 06:15:50.454962 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.454963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.454974 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.455005 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.455866 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.456659 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.457751 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.458039 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.458081 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.460338 (+ 2257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.460340 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.460340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.460348 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.462570 (+ 2222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.463006 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.463007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.463007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.463064 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.463254 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.463254 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.463255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.463428 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.463500 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.463908 (+ 408us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.464009 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Aug 12 06:15:50 dist-test-slave-gw5c krb5kdc[23570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.253@KRBTEST.COM for kudu/127.0.176.252@KRBTEST.COM
I20260812 06:15:50.472764 23926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.455640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52530 (local address 127.0.176.252:43931)
0812 06:15:50.455684 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.455686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.459376 (+ 3690us) server_negotiation.cc:407] Connection header received
0812 06:15:50.459522 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.459523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.459533 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.459564 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.465904 (+ 6340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.466643 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.467707 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.468004 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.468044 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.469655 (+ 1611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.469656 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.469657 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.469663 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.471327 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.471770 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.471771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.471771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.471829 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.472023 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.472024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.472024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.472156 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.472235 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.472458 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.472544 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:15:50.472970 23806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.463818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:43931 (local address 127.0.0.1:52540)
0812 06:15:50.463919 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:50.463930 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:50.463966 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:50.464334 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:50.464336 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:50.464500 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:50.464540 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.464541 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.465523 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.465524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.466318 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:50.466320 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.466857 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.466859 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:50.466915 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.467456 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:50.467461 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:50.469335 (+ 1874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:50.471751 (+ 2416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.471752 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.471752 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.471965 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.472165 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:50.472166 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:50.472166 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:50.472219 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:50.472501 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:50.472502 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:50.472548 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 06:15:50.472732 (+ 184us) client_negotiation.cc:240] Negotiation successful
0812 06:15:50.472865 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 06:15:50.473268 23919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:50.464145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52540 (local address 127.0.176.252:43931)
0812 06:15:50.464191 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:50.464193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:50.464201 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:15:50.464224 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:50.464224 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:50.464233 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:50.464290 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:50.464632 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.465422 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.466414 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:50.466739 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:50.466800 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:50.469438 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:50.469439 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:50.469439 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:50.469447 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:50.471655 (+ 2208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.472044 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.472045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.472046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.472100 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:50.472282 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:50.472282 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:50.472283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:50.472415 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:50.472474 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:50.473102 (+ 628us) server_negotiation.cc:299] Negotiation successful
0812 06:15:50.473187 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:15:50.475073 23803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa: Bootstrap starting.
I20260812 06:15:50.476315 23803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:50.476682 23803 log.cc:824] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:50.477682 23803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa: No bootstrap required, opened a new log
I20260812 06:15:50.479839 23803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } }
I20260812 06:15:50.479996 23803 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:50.480043 23803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95d3d22a85de42a5a8138b51c703c9aa, State: Initialized, Role: FOLLOWER
I20260812 06:15:50.480163 23803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } }
I20260812 06:15:50.480460 23985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } } }
I20260812 06:15:50.480603 23985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:15:50.480517 23803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [sys.catalog]: configured and running, proceeding with master startup.
W20260812 06:15:50.483173 24005 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:15:50.483312 24005 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:15:50.485702 23698 master_runner.cc:263] No leader master found from master 95d3d22a85de42a5a8138b51c703c9aa
I20260812 06:15:50.485777 23698 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 06:15:50.554589 23618 tablet.cc:2369] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:15:50.647117 23855 tablet.cc:2369] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:15:50.676084 23952 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:15:50.676273 23952 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } }
I20260812 06:15:50.676589 23952 leader_election.cc:288] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13227f7c68c041e091ac311c019ea26b (127.0.176.254:43155), 95d3d22a85de42a5a8138b51c703c9aa (127.0.176.253:41239)
I20260812 06:15:50.677022 23758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95d3d22a85de42a5a8138b51c703c9aa" is_pre_election: true
I20260812 06:15:50.677001 23651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13227f7c68c041e091ac311c019ea26b" is_pre_election: true
I20260812 06:15:50.677187 23758 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb927cc237a44ac2a7e4aee40d1f8bfa in term 0.
I20260812 06:15:50.677187 23651 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb927cc237a44ac2a7e4aee40d1f8bfa in term 0.
I20260812 06:15:50.677405 23849 leader_election.cc:302] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95d3d22a85de42a5a8138b51c703c9aa, cb927cc237a44ac2a7e4aee40d1f8bfa; no voters:
I20260812 06:15:50.677553 23952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:15:50.677647 23952 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:15:50.677682 23952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:50.678465 23952 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } }
I20260812 06:15:50.678627 23952 leader_election.cc:288] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [CANDIDATE]: Term 1 election: Requested vote from peers 13227f7c68c041e091ac311c019ea26b (127.0.176.254:43155), 95d3d22a85de42a5a8138b51c703c9aa (127.0.176.253:41239)
I20260812 06:15:50.678855 23651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13227f7c68c041e091ac311c019ea26b"
I20260812 06:15:50.678903 23758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95d3d22a85de42a5a8138b51c703c9aa"
I20260812 06:15:50.678977 23651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:50.679021 23758 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:50.679855 23758 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb927cc237a44ac2a7e4aee40d1f8bfa in term 1.
I20260812 06:15:50.680023 23651 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb927cc237a44ac2a7e4aee40d1f8bfa in term 1.
I20260812 06:15:50.680147 23849 leader_election.cc:302] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95d3d22a85de42a5a8138b51c703c9aa, cb927cc237a44ac2a7e4aee40d1f8bfa; no voters:
I20260812 06:15:50.680251 23952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:15:50.680464 23952 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [term 1 LEADER]: Becoming Leader. State: Replica: cb927cc237a44ac2a7e4aee40d1f8bfa, State: Running, Role: LEADER
I20260812 06:15:50.680588 23952 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } }
I20260812 06:15:50.681039 24007 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb927cc237a44ac2a7e4aee40d1f8bfa. Latest consensus state: current_term: 1 leader_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } } }
I20260812 06:15:50.681137 24007 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:50.681419 24010 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:15:50.681622 24010 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:15:50.683180 23758 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [term 1 FOLLOWER]: Refusing update from remote peer cb927cc237a44ac2a7e4aee40d1f8bfa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:15:50.683199 23651 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [term 1 FOLLOWER]: Refusing update from remote peer cb927cc237a44ac2a7e4aee40d1f8bfa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:15:50.683539 24007 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:15:50.683688 23952 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:15:50.685149 23928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb927cc237a44ac2a7e4aee40d1f8bfa. Latest consensus state: current_term: 1 leader_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } } }
I20260812 06:15:50.685263 23928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:15:50.685473 23985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb927cc237a44ac2a7e4aee40d1f8bfa. Latest consensus state: current_term: 1 leader_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } } }
I20260812 06:15:50.685576 23985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:15:50.686537 24007 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } } }
I20260812 06:15:50.686637 24007 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:50.686704 24013 mvcc.cc:205] Tried to move back new op lower bound from 7317566876395491328 to 7317566876388315136. Current Snapshot: MvccSnapshot[applied={T|T < 7317566876395491328}]
I20260812 06:15:50.686730 23928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } } }
I20260812 06:15:50.686811 23928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:15:50.686908 23952 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } } }
I20260812 06:15:50.686991 23952 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:50.687321 23985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13227f7c68c041e091ac311c019ea26b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43155 } } peers { permanent_uuid: "95d3d22a85de42a5a8138b51c703c9aa" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 41239 } } peers { permanent_uuid: "cb927cc237a44ac2a7e4aee40d1f8bfa" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 43931 } } }
I20260812 06:15:50.687453 23985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:15:50.687497 24010 catalog_manager.cc:1347] Generated new cluster ID: 011c4d008b41437fb5de05fe5c99d919
I20260812 06:15:50.687553 24010 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:15:50.701593 24010 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:15:50.702229 24010 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:15:50.706327 24010 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb927cc237a44ac2a7e4aee40d1f8bfa: Generated new TSK 0
I20260812 06:15:50.706552 24010 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:15:51.429857 23944 catalog_manager.cc:1259] Loaded cluster ID: 011c4d008b41437fb5de05fe5c99d919
I20260812 06:15:51.429968 23944 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b: loading cluster ID for follower catalog manager: success
I20260812 06:15:51.430780 23944 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b: acquiring CA information for follower catalog manager: success
I20260812 06:15:51.431097 23944 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 13227f7c68c041e091ac311c019ea26b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:15:51.483894 24005 catalog_manager.cc:1259] Loaded cluster ID: 011c4d008b41437fb5de05fe5c99d919
I20260812 06:15:51.483994 24005 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa: loading cluster ID for follower catalog manager: success
I20260812 06:15:51.484764 24005 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa: acquiring CA information for follower catalog manager: success
I20260812 06:15:51.485033 24005 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 95d3d22a85de42a5a8138b51c703c9aa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:15:51.777289 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 23587
I20260812 06:15:51.793428 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 23698
I20260812 06:15:51.809353 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 23813
2026-08-12T06:15:51Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3323 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:15:51 dist-test-slave-gw5c krb5kdc[24038](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:15:51 dist-test-slave-gw5c krb5kdc[24038](info): set up 2 sockets
Aug 12 06:15:51 dist-test-slave-gw5c krb5kdc[24038](info): commencing operation
krb5kdc: starting...
W20260812 06:15:53.121773 707 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:15:53 dist-test-slave-gw5c krb5kdc[24038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:15:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:15:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:15:53.257881 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43943
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:43943
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:53.344911 24056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:53.345211 24056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:53.345254 24056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:53.346506 24056 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:15:53.346601 24056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:53.346625 24056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:53.346647 24056 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:15:53.346681 24056 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:15:53.348352 24056 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:43943
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:53.348686 24056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:53.348966 24056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:53.354562 24072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:53.354557 24068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:53.354557 24065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:53.354974 24056 server_base.cc:1034] running on GCE node
I20260812 06:15:53.355264 24056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:53.355633 24056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:53.356833 24056 hybrid_clock.cc:648] HybridClock initialized: now 1786515353356793 us; error 82 us; skew 500 ppm
Aug 12 06:15:53 dist-test-slave-gw5c krb5kdc[24038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515353, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:53.359627 24056 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:15:53.360137 24056 webserver.cc:460] Webserver started at http://127.0.176.254:44545/ using document root <none> and password file <none>
I20260812 06:15:53.360359 24056 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:53.360404 24056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:53.360499 24056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:15:53.361569 24056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "cc046443f5224875a7c59e00f2594273"
format_stamp: "Formatted at 2026-08-12 06:15:53 on dist-test-slave-gw5c"
server_key: "16e3af6e99a46d28ade29357ea8059ab"
server_key_iv: "37b97525099e6a81f9158d173463eecd"
server_key_version: "encryptionkey@0"
I20260812 06:15:53.361886 24056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "cc046443f5224875a7c59e00f2594273"
format_stamp: "Formatted at 2026-08-12 06:15:53 on dist-test-slave-gw5c"
server_key: "16e3af6e99a46d28ade29357ea8059ab"
server_key_iv: "37b97525099e6a81f9158d173463eecd"
server_key_version: "encryptionkey@0"
I20260812 06:15:53.363247 24056 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 06:15:53.364117 24083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:53.364331 24056 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:15:53.364413 24056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "cc046443f5224875a7c59e00f2594273"
format_stamp: "Formatted at 2026-08-12 06:15:53 on dist-test-slave-gw5c"
server_key: "16e3af6e99a46d28ade29357ea8059ab"
server_key_iv: "37b97525099e6a81f9158d173463eecd"
server_key_version: "encryptionkey@0"
I20260812 06:15:53.364516 24056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:53.381093 24056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:53.383754 24056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:53.383929 24056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:53.388437 24056 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:43943
I20260812 06:15:53.388475 24163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:43943 every 8 connection(s)
I20260812 06:15:53.388854 24056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:15:53.389802 24164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:53.392438 24164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273: Bootstrap starting.
I20260812 06:15:53.393193 24164 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:53.393513 24164 log.cc:824] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:53.394313 24164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273: No bootstrap required, opened a new log
I20260812 06:15:53.394697 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 24056
I20260812 06:15:53.394817 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:15:53.395052 707 external_mini_cluster.cc:1428] Setting key 3cc98544b38e470287c8b97dc0aa7381
I20260812 06:15:53.396607 24164 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc046443f5224875a7c59e00f2594273" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43943 } }
I20260812 06:15:53.396797 24164 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:53.396842 24164 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc046443f5224875a7c59e00f2594273, State: Initialized, Role: FOLLOWER
I20260812 06:15:53.396999 24164 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc046443f5224875a7c59e00f2594273" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43943 } }
I20260812 06:15:53.397097 24164 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:15:53.397135 24164 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:15:53.397189 24164 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:53.398331 24164 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc046443f5224875a7c59e00f2594273" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43943 } }
I20260812 06:15:53.398438 24164 leader_election.cc:302] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc046443f5224875a7c59e00f2594273; no voters:
I20260812 06:15:53.398666 24164 leader_election.cc:288] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:15:53.398697 24172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:15:53.398816 24172 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [term 1 LEADER]: Becoming Leader. State: Replica: cc046443f5224875a7c59e00f2594273, State: Running, Role: LEADER
I20260812 06:15:53.398908 24172 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc046443f5224875a7c59e00f2594273" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43943 } }
I20260812 06:15:53.399003 24164 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:15:53.399263 24179 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc046443f5224875a7c59e00f2594273. Latest consensus state: current_term: 1 leader_uuid: "cc046443f5224875a7c59e00f2594273" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc046443f5224875a7c59e00f2594273" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43943 } } }
I20260812 06:15:53.399369 24179 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:53.399564 24174 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc046443f5224875a7c59e00f2594273" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc046443f5224875a7c59e00f2594273" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43943 } } }
I20260812 06:15:53.399621 24174 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273 [sys.catalog]: This master's current role is: LEADER
W20260812 06:15:53.401073 24199 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:15:53.401140 24199 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:15:53.401187 24183 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:15:53.401360 24183 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 06:15:53 dist-test-slave-gw5c krb5kdc[24038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:53.403785 24183 catalog_manager.cc:1347] Generated new cluster ID: 47e575bf1c634530a3390b6b38e3151c
I20260812 06:15:53.403841 24183 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:15:53.408018 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:53.395766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53254 (local address 127.0.176.254:43943)
0812 06:15:53.395973 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:53.395981 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:53.396008 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:15:53.396590 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:53.396599 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:53.396660 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:53.396824 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:53.397707 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:53.398854 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:53.400036 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:53.400676 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:53.400821 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:53.403871 (+ 3050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:53.403875 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:53.403875 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:53.403887 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:53.405936 (+ 2049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:53.406590 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:53.406593 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:53.406593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:53.406732 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:53.406998 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:53.406999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:53.406999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:53.407313 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:53.407494 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:53.407646 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 06:15:53.407793 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":106,"threads_started":1}
I20260812 06:15:53.409212 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:15:53.419203 24183 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:15:53.419854 24183 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:15:53.425405 24183 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc046443f5224875a7c59e00f2594273: Generated new TSK 0
I20260812 06:15:53.425632 24183 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:15:53.463665 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 24056
2026-08-12T06:15:53Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1646 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:15:53 dist-test-slave-gw5c krb5kdc[24210](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:15:53 dist-test-slave-gw5c krb5kdc[24210](info): set up 2 sockets
Aug 12 06:15:53 dist-test-slave-gw5c krb5kdc[24210](info): commencing operation
krb5kdc: starting...
W20260812 06:15:54.761677 707 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:15:54 dist-test-slave-gw5c krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:15:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:15:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:15:54.892863 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42259
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:42259
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:54.981110 24229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:54.981380 24229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:54.981428 24229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:54.982625 24229 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:15:54.982700 24229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:54.982726 24229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:54.982748 24229 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:15:54.982774 24229 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:15:54.984364 24229 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:42259
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:54.984695 24229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:54.984951 24229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:54.990231 24243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:54.990257 24236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:54.990242 24240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:54.990332 24229 server_base.cc:1034] running on GCE node
I20260812 06:15:54.990760 24229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:54.991094 24229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:54.992264 24229 hybrid_clock.cc:648] HybridClock initialized: now 1786515354992227 us; error 42 us; skew 500 ppm
Aug 12 06:15:54 dist-test-slave-gw5c krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515354, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:54.996526 24229 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:15:54.997411 24229 webserver.cc:460] Webserver started at http://127.0.176.254:41193/ using document root <none> and password file <none>
I20260812 06:15:54.997766 24229 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:54.997828 24229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:54.997937 24229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:15:54.999114 24229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "4cbde3633afb486ebed237deccaf0f7b"
format_stamp: "Formatted at 2026-08-12 06:15:54 on dist-test-slave-gw5c"
server_key: "320bed6c16be9527deb63b0f29c19ab2"
server_key_iv: "c14d263407c96f7c8c33b3dec3fee124"
server_key_version: "encryptionkey@0"
I20260812 06:15:54.999549 24229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "4cbde3633afb486ebed237deccaf0f7b"
format_stamp: "Formatted at 2026-08-12 06:15:54 on dist-test-slave-gw5c"
server_key: "320bed6c16be9527deb63b0f29c19ab2"
server_key_iv: "c14d263407c96f7c8c33b3dec3fee124"
server_key_version: "encryptionkey@0"
I20260812 06:15:55.001228 24229 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:55.002154 24252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:55.002465 24229 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:55.002689 24229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "4cbde3633afb486ebed237deccaf0f7b"
format_stamp: "Formatted at 2026-08-12 06:15:54 on dist-test-slave-gw5c"
server_key: "320bed6c16be9527deb63b0f29c19ab2"
server_key_iv: "c14d263407c96f7c8c33b3dec3fee124"
server_key_version: "encryptionkey@0"
I20260812 06:15:55.002802 24229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:55.025899 24229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:55.028575 24229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:55.028769 24229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:55.033169 24229 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:42259
I20260812 06:15:55.033206 24328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:42259 every 8 connection(s)
I20260812 06:15:55.033596 24229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:15:55.034659 24331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:55.037128 24331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Bootstrap starting.
I20260812 06:15:55.037703 24331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:55.037973 24331 log.cc:824] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:55.039072 24331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: No bootstrap required, opened a new log
I20260812 06:15:55.039798 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 24229
I20260812 06:15:55.040040 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:15:55.040328 707 external_mini_cluster.cc:1428] Setting key 1821c7463c94bf0df49c112503ebb098
I20260812 06:15:55.041903 24331 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } }
I20260812 06:15:55.042058 24331 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:55.042081 24331 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cbde3633afb486ebed237deccaf0f7b, State: Initialized, Role: FOLLOWER
I20260812 06:15:55.042346 24331 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } }
I20260812 06:15:55.042465 24331 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:15:55.042503 24331 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:15:55.042604 24331 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:55.043340 24331 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } }
I20260812 06:15:55.043501 24331 leader_election.cc:302] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cbde3633afb486ebed237deccaf0f7b; no voters:
I20260812 06:15:55.043686 24331 leader_election.cc:288] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:15:55.043732 24341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:15:55.043885 24341 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 1 LEADER]: Becoming Leader. State: Replica: 4cbde3633afb486ebed237deccaf0f7b, State: Running, Role: LEADER
I20260812 06:15:55.043974 24331 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:15:55.044035 24341 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } }
I20260812 06:15:55.044348 24341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cbde3633afb486ebed237deccaf0f7b. Latest consensus state: current_term: 1 leader_uuid: "4cbde3633afb486ebed237deccaf0f7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } } }
I20260812 06:15:55.044452 24341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:55.044359 24344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4cbde3633afb486ebed237deccaf0f7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } } }
I20260812 06:15:55.044622 24344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:55.044680 24353 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:15:55.045282 24353 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:15:55.047775 24353 catalog_manager.cc:1347] Generated new cluster ID: 02977f2b587441f0bfcad08248201824
I20260812 06:15:55.047840 24353 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:15:55 dist-test-slave-gw5c krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:55.053243 24340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.040952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36014 (local address 127.0.176.254:42259)
0812 06:15:55.041137 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:55.041145 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:55.041175 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:15:55.041890 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:55.041899 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:55.041970 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:55.042156 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:55.043007 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.044307 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.045462 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.046181 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.046332 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.049206 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:55.049211 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:55.049211 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:55.049225 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:55.050981 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:55.051379 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:55.051383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:55.051384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:55.051681 (+ 297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:55.051945 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:55.051946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:55.051946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:55.052210 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:55.052899 (+ 689us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:55.052965 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 06:15:55.053086 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":88,"threads_started":1}
I20260812 06:15:55.068176 24353 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:15:55.068966 24353 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:15:55.073400 24353 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Generated new TSK 0
I20260812 06:15:55.073603 24353 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:15:55.110304 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42259
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:55.197352 24371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:55.197602 24371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:55.197630 24371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:55.199060 24371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:55.199121 24371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:55.199152 24371 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:15:55.200814 24371 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:55.201043 24371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:55.201265 24371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:55.206524 24381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:55.206518 24380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:55.206549 24384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:55.206779 24371 server_base.cc:1034] running on GCE node
I20260812 06:15:55.207028 24371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:55.207329 24371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:55.208534 24371 hybrid_clock.cc:648] HybridClock initialized: now 1786515355208511 us; error 42 us; skew 500 ppm
Aug 12 06:15:55 dist-test-slave-gw5c krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515355, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:55.211237 24371 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:15:55.211762 24371 webserver.cc:460] Webserver started at http://127.0.176.193:33651/ using document root <none> and password file <none>
I20260812 06:15:55.212034 24371 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:55.212108 24371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:55.212271 24371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:15:55.213379 24371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "0d690cefcd18454880ee25f18651d267"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "dddb576263051cfdc8457ba5bff566b1"
server_key_iv: "0c4547ecf1c967a9b464233e8a9bfad4"
server_key_version: "encryptionkey@0"
I20260812 06:15:55.213763 24371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "0d690cefcd18454880ee25f18651d267"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "dddb576263051cfdc8457ba5bff566b1"
server_key_iv: "0c4547ecf1c967a9b464233e8a9bfad4"
server_key_version: "encryptionkey@0"
I20260812 06:15:55.215130 24371 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:15:55.215950 24396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:55.216125 24371 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:55.216243 24371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "0d690cefcd18454880ee25f18651d267"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "dddb576263051cfdc8457ba5bff566b1"
server_key_iv: "0c4547ecf1c967a9b464233e8a9bfad4"
server_key_version: "encryptionkey@0"
I20260812 06:15:55.216321 24371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:55.232992 24371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:55.235220 24371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:55.235437 24371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:55.235730 24371 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:55.236065 24371 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:15:55.236121 24371 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:55.236167 24371 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:15:55.236200 24371 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:55.242453 24371 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:41581
I20260812 06:15:55.242539 24573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:41581 every 8 connection(s)
I20260812 06:15:55.242877 24371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:15:55.246770 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 24371
I20260812 06:15:55.246874 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:15:55.247099 707 external_mini_cluster.cc:1428] Setting key f7f17d48492f36d7e26f518f95df4c9b
Aug 12 06:15:55 dist-test-slave-gw5c krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515355, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:55.253355 24340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.243872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:37777 (local address 127.0.176.254:42259)
0812 06:15:55.243985 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:55.243987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:55.244164 (+ 177us) server_negotiation.cc:407] Connection header received
0812 06:15:55.244752 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:55.244753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:55.244769 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:55.244837 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:55.245870 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.246376 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.247600 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.247897 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.247993 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.250237 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:55.250239 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:55.250239 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:55.250247 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:55.251845 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:55.252300 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:55.252301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:55.252302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:55.252368 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:55.252639 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:55.252640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:55.252641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:55.252768 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:55.252842 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:55.253163 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 06:15:55.253261 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 06:15:55.253556 24576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.243794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:37777)
0812 06:15:55.244028 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:55.244072 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:55.244631 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:55.244892 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:55.244895 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:55.245573 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:55.245774 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.245779 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.246472 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.246473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.247540 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.247543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.248011 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.248013 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.248116 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.248684 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:55.248692 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:55.250109 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:55.251958 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:55.251967 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:55.251969 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:55.252217 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:55.252440 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:55.252441 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:55.252442 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:55.252568 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:55.252843 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:55.252851 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:55.253024 (+ 173us) client_negotiation.cc:769] Sending connection context
0812 06:15:55.253140 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 06:15:55.253310 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":92,"threads_started":1}
I20260812 06:15:55.254127 24574 heartbeater.cc:347] Connected to a master server at 127.0.176.254:42259
I20260812 06:15:55.254216 24574 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:55.254431 24574 heartbeater.cc:511] Master 127.0.176.254:42259 requested a full tablet report, sending...
I20260812 06:15:55.255055 24277 ts_manager.cc:194] Registered new tserver with Master: 0d690cefcd18454880ee25f18651d267 (127.0.176.193:41581)
I20260812 06:15:55.256057 24277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:37777
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:15:55.274808 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42259
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:55.360834 24581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:55.361073 24581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:55.361099 24581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:55.362272 24581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:55.362314 24581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:55.362342 24581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:15:55.363852 24581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:55.364069 24581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:55.364274 24581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:55.369591 24589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:55.369591 24588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:55.369587 24591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:55.369928 24581 server_base.cc:1034] running on GCE node
I20260812 06:15:55.370193 24581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:55.370471 24581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:55.371659 24581 hybrid_clock.cc:648] HybridClock initialized: now 1786515355371641 us; error 40 us; skew 500 ppm
Aug 12 06:15:55 dist-test-slave-gw5c krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515355, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:55.375761 24581 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:15:55.376385 24581 webserver.cc:460] Webserver started at http://127.0.176.194:42845/ using document root <none> and password file <none>
I20260812 06:15:55.376693 24581 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:55.376776 24581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:55.376935 24581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:15:55.378206 24581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "ea5d98c2d03749b98354377ac0fb7beb"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "c522ae634c7e43549020d6f53220e492"
server_key_iv: "941c0508c710465cd08752e215779f93"
server_key_version: "encryptionkey@0"
I20260812 06:15:55.378675 24581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "ea5d98c2d03749b98354377ac0fb7beb"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "c522ae634c7e43549020d6f53220e492"
server_key_iv: "941c0508c710465cd08752e215779f93"
server_key_version: "encryptionkey@0"
I20260812 06:15:55.381650 24581 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260812 06:15:55.382611 24605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:55.382834 24581 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:15:55.382961 24581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "ea5d98c2d03749b98354377ac0fb7beb"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "c522ae634c7e43549020d6f53220e492"
server_key_iv: "941c0508c710465cd08752e215779f93"
server_key_version: "encryptionkey@0"
I20260812 06:15:55.383061 24581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:55.395648 24581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:55.397794 24581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:55.398286 24581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:55.398954 24581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:55.399525 24581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:15:55.399596 24581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:55.399642 24581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:15:55.399672 24581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:55.406916 24581 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:34267
I20260812 06:15:55.407032 24785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:34267 every 8 connection(s)
I20260812 06:15:55.407374 24581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:15:55.411679 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 24581
I20260812 06:15:55.411856 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:15:55.412125 707 external_mini_cluster.cc:1428] Setting key ef0884496654697eba0afcdf180aceb8
Aug 12 06:15:55 dist-test-slave-gw5c krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515355, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:55.420441 24340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.408531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:47851 (local address 127.0.176.254:42259)
0812 06:15:55.408703 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:55.408706 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:55.408925 (+ 219us) server_negotiation.cc:407] Connection header received
0812 06:15:55.409469 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:55.409470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:55.409480 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:55.409539 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:55.410593 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.411119 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.412497 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.412711 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.412802 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.416699 (+ 3897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:55.416701 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:55.416702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:55.416715 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:55.418710 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:55.419253 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:55.419255 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:55.419256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:55.419328 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:55.419636 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:55.419637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:55.419637 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:55.419773 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:55.419851 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:55.420227 (+ 376us) server_negotiation.cc:299] Negotiation successful
0812 06:15:55.420334 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260812 06:15:55.420643 24790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.408476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:47851)
0812 06:15:55.408769 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:55.408818 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:55.409375 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:55.409597 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:55.409600 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:55.410239 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:55.410454 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.410459 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.411247 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.411248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.412379 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.412383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.412814 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.412816 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.412984 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.413947 (+ 963us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:55.413959 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:55.416555 (+ 2596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:55.418828 (+ 2273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:55.418842 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:55.418845 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:55.419156 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:55.419424 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:55.419425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:55.419426 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:55.419554 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:55.419851 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:55.419859 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:55.420072 (+ 213us) client_negotiation.cc:769] Sending connection context
0812 06:15:55.420187 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 06:15:55.420373 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":194,"threads_started":1}
I20260812 06:15:55.421264 24786 heartbeater.cc:347] Connected to a master server at 127.0.176.254:42259
I20260812 06:15:55.421358 24786 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:55.421577 24786 heartbeater.cc:511] Master 127.0.176.254:42259 requested a full tablet report, sending...
I20260812 06:15:55.422533 24277 ts_manager.cc:194] Registered new tserver with Master: ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194:34267)
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
I20260812 06:15:55.423105 24277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:47851
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:15:55.440575 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42259
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:55.527603 24794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:55.527844 24794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:55.527874 24794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:55.529141 24794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:55.529201 24794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:55.529232 24794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:15:55.530833 24794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:55.531117 24794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:55.531412 24794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:55.536705 24801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:55.536789 24800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:55.536710 24803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:55.537586 24794 server_base.cc:1034] running on GCE node
I20260812 06:15:55.537866 24794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:55.538152 24794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:55.539341 24794 hybrid_clock.cc:648] HybridClock initialized: now 1786515355539328 us; error 49 us; skew 500 ppm
Aug 12 06:15:55 dist-test-slave-gw5c krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515355, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:55.542335 24794 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:15:55.542961 24794 webserver.cc:460] Webserver started at http://127.0.176.195:43543/ using document root <none> and password file <none>
I20260812 06:15:55.543237 24794 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:55.543315 24794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:55.543511 24794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:15:55.544978 24794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "e1af24f5c3d243a286658584ff1c99bd"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "b6d80bcd8162ba8b1c0fa68e0d20d2c3"
server_key_iv: "af41872b430860032e9bb14e42c5a54e"
server_key_version: "encryptionkey@0"
I20260812 06:15:55.545383 24794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "e1af24f5c3d243a286658584ff1c99bd"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "b6d80bcd8162ba8b1c0fa68e0d20d2c3"
server_key_iv: "af41872b430860032e9bb14e42c5a54e"
server_key_version: "encryptionkey@0"
I20260812 06:15:55.546979 24794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:15:55.547859 24820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:55.548069 24794 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:15:55.548183 24794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "e1af24f5c3d243a286658584ff1c99bd"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "b6d80bcd8162ba8b1c0fa68e0d20d2c3"
server_key_iv: "af41872b430860032e9bb14e42c5a54e"
server_key_version: "encryptionkey@0"
I20260812 06:15:55.548265 24794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:55.567507 24794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:55.570062 24794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:55.570262 24794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:55.570533 24794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:55.570890 24794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:15:55.570947 24794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:55.570994 24794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:15:55.571028 24794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:55.578001 24794 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:35839
I20260812 06:15:55.578096 24987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:35839 every 8 connection(s)
I20260812 06:15:55.578461 24794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:15:55 dist-test-slave-gw5c krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515355, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:55.587611 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 24794
I20260812 06:15:55.587728 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:15:55.587937 707 external_mini_cluster.cc:1428] Setting key 9cf221e7ab4890a136258ca4270af8e9
I20260812 06:15:55.591490 24340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.579360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:50657 (local address 127.0.176.254:42259)
0812 06:15:55.579453 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:55.579457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:55.579707 (+ 250us) server_negotiation.cc:407] Connection header received
0812 06:15:55.580996 (+ 1289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:55.580998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:55.581019 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:55.581203 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:55.582355 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.583050 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.584640 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.584873 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.584973 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.588183 (+ 3210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:55.588185 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:55.588185 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:55.588196 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:55.589806 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:55.590294 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:55.590295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:55.590295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:55.590379 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:55.590663 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:55.590664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:55.590664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:55.590851 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:55.590935 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:55.591253 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 06:15:55.591347 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:15:55.591754 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.579354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:50657)
0812 06:15:55.579573 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:55.579612 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:55.580765 (+ 1153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:55.581330 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:55.581335 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:55.581994 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:55.582212 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.582219 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.583226 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.583228 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.584490 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.584496 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.584991 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.584993 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.585137 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.585865 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:55.585879 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:55.588060 (+ 2181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:55.589895 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:55.589906 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:55.589909 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:55.590176 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:55.590446 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:55.590446 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:55.590447 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:55.590557 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:55.590949 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:55.590957 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:55.591109 (+ 152us) client_negotiation.cc:769] Sending connection context
0812 06:15:55.591207 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 06:15:55.591473 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":123,"threads_started":1}
I20260812 06:15:55.592211 24988 heartbeater.cc:347] Connected to a master server at 127.0.176.254:42259
I20260812 06:15:55.592315 24988 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:55.592490 24988 heartbeater.cc:511] Master 127.0.176.254:42259 requested a full tablet report, sending...
I20260812 06:15:55.592878 24277 ts_manager.cc:194] Registered new tserver with Master: e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839)
I20260812 06:15:55.593240 24277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:50657
I20260812 06:15:55.600389 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:15:55.608891 24340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.601976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36026 (local address 127.0.176.254:42259)
0812 06:15:55.602062 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:55.602064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:55.602162 (+ 98us) server_negotiation.cc:407] Connection header received
0812 06:15:55.602266 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:55.602267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:55.602279 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:55.602341 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:55.602955 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.603605 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.604358 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.604572 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.604649 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.606130 (+ 1481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:55.606132 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:55.606132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:55.606141 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:55.607614 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:55.607984 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:55.607985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:55.607985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:55.608050 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:55.608278 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:55.608278 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:55.608279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:55.608454 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:55.608570 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:55.608685 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 06:15:55.608778 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 06:15:55.610714 24277 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36026:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:15:55.612545 24277 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:15:55.619832 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.615233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:34267 (local address 127.0.0.1:39352)
0812 06:15:55.615473 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:55.615521 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:55.615605 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:55.616105 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:55.616109 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:55.616111 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:55.616199 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.616201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.617176 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.617178 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.618426 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.618429 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.619465 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.619467 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.619576 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.619585 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:15:55.619634 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 06:15:55.619705 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":103,"threads_started":1}
I20260812 06:15:55.619832 25012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.615623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48540 (local address 127.0.176.193:41581)
0812 06:15:55.615799 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:55.615804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:55.616024 (+ 220us) server_negotiation.cc:407] Connection header received
0812 06:15:55.616073 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:55.616076 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:55.616093 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:55.616170 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:55.616361 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.617516 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.618769 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.619302 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.619402 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.619508 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:55.619699 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 06:15:55.619741 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":103,"threads_started":1}
I20260812 06:15:55.620100 25011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.615487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39352 (local address 127.0.176.194:34267)
0812 06:15:55.615694 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:55.615696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:55.615706 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:15:55.615740 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:55.615742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:55.615755 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:55.615860 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:55.616292 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.617059 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.618533 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.619310 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.619785 (+ 475us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.619903 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:55.619932 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 06:15:55.619991 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":99,"threads_started":1}
I20260812 06:15:55.620321 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.615352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36424 (local address 127.0.176.195:35839)
0812 06:15:55.615600 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:55.615605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:55.616017 (+ 412us) server_negotiation.cc:407] Connection header received
0812 06:15:55.616068 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:55.616070 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:55.616088 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:55.616159 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:55.616381 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.617516 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.618788 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.619639 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.619700 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.619751 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:55.620085 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 06:15:55.620141 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":131,"threads_started":1}
I20260812 06:15:55.620332 25015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.615811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:41581 (local address 127.0.0.1:48540)
0812 06:15:55.615938 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:55.615947 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:55.616001 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:55.616253 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:55.616253 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:55.616255 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:55.616291 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.616292 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.617643 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.617644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.618675 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.618676 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.619473 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.619474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.619563 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.619583 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 06:15:55.619677 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 06:15:55.619728 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260812 06:15:55.620715 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.615233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:35839 (local address 127.0.0.1:36424)
0812 06:15:55.615867 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:55.615877 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:55.615950 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:55.616234 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:55.616235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:55.616238 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:55.616300 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.616302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.617672 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.617673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.618688 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.618691 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.619785 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.619786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.619844 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.619847 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:15:55.620585 (+ 738us) client_negotiation.cc:240] Negotiation successful
0812 06:15:55.620636 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260812 06:15:55.620947 24680 tablet_service.cc:1467] Processing CreateTablet for tablet 3cecb8e809174460b9564856c8ec9bda (DEFAULT_TABLE table=test-table [id=ee0ae9ec4f4d4946ad764c0dc7d56c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:15:55.621203 24472 tablet_service.cc:1467] Processing CreateTablet for tablet 3cecb8e809174460b9564856c8ec9bda (DEFAULT_TABLE table=test-table [id=ee0ae9ec4f4d4946ad764c0dc7d56c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:15:55.621397 24680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cecb8e809174460b9564856c8ec9bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:55.621434 24890 tablet_service.cc:1467] Processing CreateTablet for tablet 3cecb8e809174460b9564856c8ec9bda (DEFAULT_TABLE table=test-table [id=ee0ae9ec4f4d4946ad764c0dc7d56c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:15:55.621583 24472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cecb8e809174460b9564856c8ec9bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:55.621766 24890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cecb8e809174460b9564856c8ec9bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:55.624439 25016 tablet_bootstrap.cc:492] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb: Bootstrap starting.
I20260812 06:15:55.625092 25019 tablet_bootstrap.cc:492] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Bootstrap starting.
I20260812 06:15:55.625674 25016 tablet_bootstrap.cc:654] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:55.626004 25019 tablet_bootstrap.cc:654] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:55.626345 25016 log.cc:824] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:55.626689 25019 log.cc:824] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:55.627112 25018 tablet_bootstrap.cc:492] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd: Bootstrap starting.
I20260812 06:15:55.627460 25016 tablet_bootstrap.cc:492] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb: No bootstrap required, opened a new log
I20260812 06:15:55.627553 25016 ts_tablet_manager.cc:1397] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:15:55.627564 25019 tablet_bootstrap.cc:492] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: No bootstrap required, opened a new log
I20260812 06:15:55.627861 25019 ts_tablet_manager.cc:1397] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260812 06:15:55.627952 25018 tablet_bootstrap.cc:654] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:55.628511 25018 log.cc:824] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:55.629261 25018 tablet_bootstrap.cc:492] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd: No bootstrap required, opened a new log
I20260812 06:15:55.629351 25018 ts_tablet_manager.cc:1397] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:15:55.629855 25016 raft_consensus.cc:348] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } }
I20260812 06:15:55.629864 25019 raft_consensus.cc:348] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } }
I20260812 06:15:55.630064 25016 raft_consensus.cc:374] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:55.630064 25019 raft_consensus.cc:374] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:55.630103 25019 raft_consensus.cc:729] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d690cefcd18454880ee25f18651d267, State: Initialized, Role: FOLLOWER
I20260812 06:15:55.630103 25016 raft_consensus.cc:729] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5d98c2d03749b98354377ac0fb7beb, State: Initialized, Role: FOLLOWER
I20260812 06:15:55.630263 25016 consensus_queue.cc:260] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } }
I20260812 06:15:55.630263 25019 consensus_queue.cc:260] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } }
I20260812 06:15:55.630612 25019 ts_tablet_manager.cc:1428] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:15:55.630611 25016 ts_tablet_manager.cc:1428] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:15:55.630664 24574 heartbeater.cc:503] Master 127.0.176.254:42259 was elected leader, sending a full tablet report...
I20260812 06:15:55.630752 24786 heartbeater.cc:503] Master 127.0.176.254:42259 was elected leader, sending a full tablet report...
I20260812 06:15:55.631742 25018 raft_consensus.cc:348] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } }
I20260812 06:15:55.631989 25018 raft_consensus.cc:374] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:55.632043 25018 raft_consensus.cc:729] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1af24f5c3d243a286658584ff1c99bd, State: Initialized, Role: FOLLOWER
I20260812 06:15:55.632179 25018 consensus_queue.cc:260] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } }
I20260812 06:15:55.632550 25018 ts_tablet_manager.cc:1428] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:15:55.632624 24988 heartbeater.cc:503] Master 127.0.176.254:42259 was elected leader, sending a full tablet report...
W20260812 06:15:55.658280 24788 tablet.cc:2369] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:15:55.743808 24575 tablet.cc:2369] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:15:55.823446 25025 raft_consensus.cc:482] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:15:55.823596 25025 raft_consensus.cc:504] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } }
I20260812 06:15:55.824079 25025 leader_election.cc:288] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d690cefcd18454880ee25f18651d267 (127.0.176.193:41581), e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839)
I20260812 06:15:55.827191 25012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.824364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:48095 (local address 127.0.176.193:41581)
0812 06:15:55.824438 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:55.824440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:55.824702 (+ 262us) server_negotiation.cc:407] Connection header received
0812 06:15:55.824783 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:55.824784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:55.824797 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:55.824866 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:55.825030 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.825506 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.826448 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.826818 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.826910 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.826921 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:55.827070 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 06:15:55.827113 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 06:15:55.827225 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.824443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:36993 (local address 127.0.176.195:35839)
0812 06:15:55.824503 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:55.824505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:55.824521 (+ 16us) server_negotiation.cc:407] Connection header received
0812 06:15:55.824547 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:55.824548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:55.824556 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:55.824625 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:55.824789 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.825284 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.826258 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.826796 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.826929 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.826939 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:55.827105 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 06:15:55.827149 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:15:55.827243 24790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.824288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:35839 (local address 127.0.176.194:36993)
0812 06:15:55.824344 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:55.824357 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:55.824420 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:55.824630 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:55.824631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:55.824633 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:55.824715 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.824717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.825373 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.825375 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.826148 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.826150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.826929 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.826930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.827023 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.827026 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:15:55.827098 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:15:55.827147 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 06:15:55.827250 25027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.824291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:41581 (local address 127.0.176.194:48095)
0812 06:15:55.824609 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:55.824619 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:55.824709 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:55.824872 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:55.824873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:55.824874 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:55.824951 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.824953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.825604 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.825605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.826350 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:55.826352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.826911 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.826912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:55.826988 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.826993 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:15:55.827061 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 06:15:55.827106 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":107,"thread_start_us":148,"threads_started":1}
I20260812 06:15:55.827666 24501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cecb8e809174460b9564856c8ec9bda" candidate_uuid: "ea5d98c2d03749b98354377ac0fb7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d690cefcd18454880ee25f18651d267" is_pre_election: true
I20260812 06:15:55.827670 24926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cecb8e809174460b9564856c8ec9bda" candidate_uuid: "ea5d98c2d03749b98354377ac0fb7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1af24f5c3d243a286658584ff1c99bd" is_pre_election: true
I20260812 06:15:55.827862 24501 raft_consensus.cc:2454] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5d98c2d03749b98354377ac0fb7beb in term 0.
I20260812 06:15:55.827872 24926 raft_consensus.cc:2454] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5d98c2d03749b98354377ac0fb7beb in term 0.
I20260812 06:15:55.828132 24607 leader_election.cc:302] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d690cefcd18454880ee25f18651d267, ea5d98c2d03749b98354377ac0fb7beb; no voters:
I20260812 06:15:55.828287 25025 raft_consensus.cc:2781] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:15:55.828353 25025 raft_consensus.cc:482] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:15:55.828373 25025 raft_consensus.cc:3037] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Advancing to term 1
W20260812 06:15:55.829064 24989 tablet.cc:2369] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:15:55.829229 25025 raft_consensus.cc:504] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } }
I20260812 06:15:55.829420 25025 leader_election.cc:288] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [CANDIDATE]: Term 1 election: Requested vote from peers 0d690cefcd18454880ee25f18651d267 (127.0.176.193:41581), e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839)
I20260812 06:15:55.829619 24926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cecb8e809174460b9564856c8ec9bda" candidate_uuid: "ea5d98c2d03749b98354377ac0fb7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1af24f5c3d243a286658584ff1c99bd"
I20260812 06:15:55.829628 24501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cecb8e809174460b9564856c8ec9bda" candidate_uuid: "ea5d98c2d03749b98354377ac0fb7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d690cefcd18454880ee25f18651d267"
I20260812 06:15:55.829715 24926 raft_consensus.cc:3037] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:55.829717 24501 raft_consensus.cc:3037] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:55.830672 24501 raft_consensus.cc:2454] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5d98c2d03749b98354377ac0fb7beb in term 1.
I20260812 06:15:55.830670 24926 raft_consensus.cc:2454] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5d98c2d03749b98354377ac0fb7beb in term 1.
I20260812 06:15:55.830958 24608 leader_election.cc:302] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1af24f5c3d243a286658584ff1c99bd, ea5d98c2d03749b98354377ac0fb7beb; no voters:
I20260812 06:15:55.831101 25025 raft_consensus.cc:2781] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:15:55.831322 25025 raft_consensus.cc:686] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [term 1 LEADER]: Becoming Leader. State: Replica: ea5d98c2d03749b98354377ac0fb7beb, State: Running, Role: LEADER
I20260812 06:15:55.831480 25025 consensus_queue.cc:237] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } }
I20260812 06:15:55.832700 24276 catalog_manager.cc:5495] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb reported cstate change: term changed from 0 to 1, leader changed from <none> to ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194). New cstate: current_term: 1 leader_uuid: "ea5d98c2d03749b98354377ac0fb7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260812 06:15:55.853122 25011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.850389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39358 (local address 127.0.176.194:34267)
0812 06:15:55.850468 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:55.850471 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:55.850480 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:15:55.850526 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:55.850527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:55.850556 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:55.850638 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:15:55.850783 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.851337 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.852252 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:55.852471 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:55.852549 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:55.852736 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:15:55.852861 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:15:55.852960 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:55.852980 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 06:15:55.853003 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 06:15:55.855233 24926 raft_consensus.cc:1261] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd [term 1 FOLLOWER]: Refusing update from remote peer ea5d98c2d03749b98354377ac0fb7beb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:15:55.855230 24501 raft_consensus.cc:1261] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Refusing update from remote peer ea5d98c2d03749b98354377ac0fb7beb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:15:55.855677 25028 consensus_queue.cc:1035] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:15:55.855829 25025 consensus_queue.cc:1035] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:15:55.858667 25031 mvcc.cc:205] Tried to move back new op lower bound from 7317566897579737088 to 7317566897486467072. Current Snapshot: MvccSnapshot[applied={T|T < 7317566897579737088}]
I20260812 06:15:55.858860 25032 mvcc.cc:205] Tried to move back new op lower bound from 7317566897579737088 to 7317566897486467072. Current Snapshot: MvccSnapshot[applied={T|T < 7317566897579737088}]
I20260812 06:15:55.858939 25033 mvcc.cc:205] Tried to move back new op lower bound from 7317566897579737088 to 7317566897486467072. Current Snapshot: MvccSnapshot[applied={T|T < 7317566897579737088}]
I20260812 06:15:55.861608 24276 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:15:55.861719 24276 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:15:55.862602 24276 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Sending DeleteTablet for 3 replicas of tablet 3cecb8e809174460b9564856c8ec9bda
I20260812 06:15:55.862931 24680 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cecb8e809174460b9564856c8ec9bda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:15:55 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:39352
I20260812 06:15:55.862967 24890 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cecb8e809174460b9564856c8ec9bda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:15:55 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:36424
I20260812 06:15:55.863221 24472 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cecb8e809174460b9564856c8ec9bda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:15:55 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:48540
I20260812 06:15:55.863265 25048 tablet_replica.cc:330] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb: stopping tablet replica
I20260812 06:15:55.863286 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 24371
I20260812 06:15:55.876581 25048 raft_consensus.cc:2229] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:15:55.876818 25048 raft_consensus.cc:2258] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:15:55.879253 25048 ts_tablet_manager.cc:1905] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:15:55.881083 25048 ts_tablet_manager.cc:1918] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:15:55.881177 25048 log.cc:1196] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/3cecb8e809174460b9564856c8ec9bda
I20260812 06:15:55.881472 25048 ts_tablet_manager.cc:1939] T 3cecb8e809174460b9564856c8ec9bda P ea5d98c2d03749b98354377ac0fb7beb: Deleting consensus metadata
I20260812 06:15:55.882015 24253 catalog_manager.cc:4841] TS ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194:34267): tablet 3cecb8e809174460b9564856c8ec9bda (table test-table [id=ee0ae9ec4f4d4946ad764c0dc7d56c19]) successfully deleted
W20260812 06:15:55.885658 24253 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:41581 (error 108)
I20260812 06:15:55.886011 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 24581
I20260812 06:15:55.886648 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:55.886138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:41581 (local address 127.0.0.1:48542)
0812 06:15:55.886555 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:55.886604 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:41581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392}
W20260812 06:15:55.892822 24253 catalog_manager.cc:4584] TS 0d690cefcd18454880ee25f18651d267 (127.0.176.193:41581): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3cecb8e809174460b9564856c8ec9bda: Network error: Client connection negotiation failed: client connection to 127.0.176.193:41581: connect: Connection refused (error 111)
I20260812 06:15:55.895078 25052 tablet_replica.cc:330] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd: stopping tablet replica
I20260812 06:15:55.895215 25052 raft_consensus.cc:2229] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:15:55.895336 25052 raft_consensus.cc:2258] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:15:55.896008 25052 ts_tablet_manager.cc:1905] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:15:55.897483 25052 ts_tablet_manager.cc:1918] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:15:55.897553 25052 log.cc:1196] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/3cecb8e809174460b9564856c8ec9bda
I20260812 06:15:55.897856 25052 ts_tablet_manager.cc:1939] T 3cecb8e809174460b9564856c8ec9bda P e1af24f5c3d243a286658584ff1c99bd: Deleting consensus metadata
I20260812 06:15:55.898460 24254 catalog_manager.cc:4841] TS e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839): tablet 3cecb8e809174460b9564856c8ec9bda (table test-table [id=ee0ae9ec4f4d4946ad764c0dc7d56c19]) successfully deleted
I20260812 06:15:55.899950 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 24794
I20260812 06:15:55.911607 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 24229
I20260812 06:15:55.925290 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42259
--webserver_interface=127.0.176.254
--webserver_port=41193
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:42259
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:56.016130 25054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:56.016404 25054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:56.016433 25054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:56.017835 25054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:15:56.017901 25054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:56.017917 25054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:56.017931 25054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:15:56.017944 25054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:15:56.019735 25054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:42259
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=41193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:56.020061 25054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:56.020334 25054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:56.031262 25067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:56.031262 25062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:56.031262 25063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:56.031601 25054 server_base.cc:1034] running on GCE node
I20260812 06:15:56.031901 25054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:56.032280 25054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:56.033474 25054 hybrid_clock.cc:648] HybridClock initialized: now 1786515356033450 us; error 43 us; skew 500 ppm
Aug 12 06:15:56 dist-test-slave-gw5c krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515356, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:56.036904 25054 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:15:56.037509 25054 webserver.cc:460] Webserver started at http://127.0.176.254:41193/ using document root <none> and password file <none>
I20260812 06:15:56.037806 25054 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:56.037911 25054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:56.039569 25054 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:15:56.040395 25078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:56.040594 25054 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:56.040716 25054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "4cbde3633afb486ebed237deccaf0f7b"
format_stamp: "Formatted at 2026-08-12 06:15:54 on dist-test-slave-gw5c"
server_key: "320bed6c16be9527deb63b0f29c19ab2"
server_key_iv: "c14d263407c96f7c8c33b3dec3fee124"
server_key_version: "encryptionkey@0"
I20260812 06:15:56.041198 25054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:56.056388 25054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:56.059031 25054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:56.059221 25054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:56.063970 25054 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:42259
I20260812 06:15:56.064013 25155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:42259 every 8 connection(s)
I20260812 06:15:56.064491 25054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:15:56.066450 25157 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:15:56.067104 25157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Bootstrap starting.
I20260812 06:15:56.072826 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 25054
I20260812 06:15:56.073233 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:41581
--local_ip_for_outbound_sockets=127.0.176.193
--tserver_master_addrs=127.0.176.254:42259
--webserver_port=33651
--webserver_interface=127.0.176.193
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:15:56.077035 25157 log.cc:824] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:56.079593 25157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:15:56.079967 25157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Bootstrap complete.
I20260812 06:15:56.082522 25157 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } }
I20260812 06:15:56.082780 25157 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cbde3633afb486ebed237deccaf0f7b, State: Initialized, Role: FOLLOWER
I20260812 06:15:56.082969 25157 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } }
I20260812 06:15:56.083047 25157 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:15:56.083122 25157 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:15:56.083180 25157 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:15:56.084435 25157 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } }
I20260812 06:15:56.084540 25157 leader_election.cc:302] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cbde3633afb486ebed237deccaf0f7b; no voters:
I20260812 06:15:56.084777 25157 leader_election.cc:288] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 06:15:56.084820 25165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:15:56.085003 25165 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 2 LEADER]: Becoming Leader. State: Replica: 4cbde3633afb486ebed237deccaf0f7b, State: Running, Role: LEADER
I20260812 06:15:56.085104 25157 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:15:56.085148 25165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } }
I20260812 06:15:56.085464 25165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cbde3633afb486ebed237deccaf0f7b. Latest consensus state: current_term: 2 leader_uuid: "4cbde3633afb486ebed237deccaf0f7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } } }
I20260812 06:15:56.085469 25167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4cbde3633afb486ebed237deccaf0f7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } } }
I20260812 06:15:56.085556 25165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:56.085590 25167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:56.085919 25171 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:15:56.086923 25171 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:15:56.087075 25171 catalog_manager.cc:1259] Loaded cluster ID: 02977f2b587441f0bfcad08248201824
I20260812 06:15:56.087122 25171 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:15:56.087610 25171 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 06:15:56.090384 25171 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 06:15:56.092645 25171 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:15:56.092900 25171 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Loaded TSK: 0
I20260812 06:15:56.093142 25171 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:15:56.178058 25160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:56.178342 25160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:56.178388 25160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:56.179898 25160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:56.179973 25160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:56.180027 25160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:15:56.181761 25160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:41581
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=33651
--tserver_master_addrs=127.0.176.254:42259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:56.182107 25160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:56.182395 25160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:56.188134 25208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:56.188234 25205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:56.188143 25203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:56.188550 25160 server_base.cc:1034] running on GCE node
I20260812 06:15:56.188812 25160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:56.189121 25160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:56.190330 25160 hybrid_clock.cc:648] HybridClock initialized: now 1786515356190304 us; error 35 us; skew 500 ppm
Aug 12 06:15:56 dist-test-slave-gw5c krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515356, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:56.197593 25160 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:15:56.198251 25160 webserver.cc:460] Webserver started at http://127.0.176.193:33651/ using document root <none> and password file <none>
I20260812 06:15:56.198508 25160 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:56.198696 25160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:56.200524 25160 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:15:56.201443 25224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:56.201680 25160 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:15:56.201786 25160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "0d690cefcd18454880ee25f18651d267"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "dddb576263051cfdc8457ba5bff566b1"
server_key_iv: "0c4547ecf1c967a9b464233e8a9bfad4"
server_key_version: "encryptionkey@0"
I20260812 06:15:56.202260 25160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:56.215682 25160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:56.218343 25160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:56.218560 25160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:56.218863 25160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:56.219457 25234 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 06:15:56.221148 25160 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:15:56.221203 25160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 06:15:56.221240 25160 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 06:15:56.222244 25160 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 06:15:56.222307 25160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 06:15:56.222339 25234 tablet_bootstrap.cc:492] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Bootstrap starting.
I20260812 06:15:56.231161 25160 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:41581
I20260812 06:15:56.231364 25397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:41581 every 8 connection(s)
I20260812 06:15:56.231787 25160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:15:56.235718 25234 log.cc:824] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:56.239178 25234 tablet_bootstrap.cc:492] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:15:56.239603 25234 tablet_bootstrap.cc:492] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Bootstrap complete.
I20260812 06:15:56.240897 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 25160
I20260812 06:15:56.241209 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:34267
--local_ip_for_outbound_sockets=127.0.176.194
--tserver_master_addrs=127.0.176.254:42259
--webserver_port=42845
--webserver_interface=127.0.176.194
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:15:56 dist-test-slave-gw5c krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515356, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:56.241827 25234 ts_tablet_manager.cc:1397] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.012s
I20260812 06:15:56.243299 25234 raft_consensus.cc:348] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } }
I20260812 06:15:56.243690 25234 raft_consensus.cc:729] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d690cefcd18454880ee25f18651d267, State: Initialized, Role: FOLLOWER
I20260812 06:15:56.243836 25234 consensus_queue.cc:260] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } }
I20260812 06:15:56.244134 25234 ts_tablet_manager.cc:1428] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:15:56.247303 25401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.232578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:49037)
0812 06:15:56.232806 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:56.232855 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:56.233485 (+ 630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:56.236140 (+ 2655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:56.236145 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:56.236497 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:56.236692 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.236698 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.237927 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.237929 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.238737 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.238740 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.239486 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.239487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.239605 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.240301 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:56.240310 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:56.242231 (+ 1921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:56.244923 (+ 2692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:56.244934 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:56.244937 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:56.245269 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:56.245814 (+ 545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:56.245815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:56.245815 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:56.245947 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:56.246511 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:56.246520 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:56.246694 (+ 174us) client_negotiation.cc:769] Sending connection context
0812 06:15:56.246796 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 06:15:56.247011 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":126,"threads_started":1}
I20260812 06:15:56.248236 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.232743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:49037 (local address 127.0.176.254:42259)
0812 06:15:56.235587 (+ 2844us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:56.235599 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:56.235656 (+ 57us) server_negotiation.cc:407] Connection header received
0812 06:15:56.235816 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:56.235824 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:56.235887 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:56.236096 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:56.236841 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.237792 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.238846 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.239308 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.239964 (+ 656us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.242395 (+ 2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:56.242400 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:56.242401 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:56.242416 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:56.244799 (+ 2383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:56.245385 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:56.245389 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:56.245389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:56.245713 (+ 324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:56.246033 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:56.246034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:56.246034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:56.246410 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:56.247660 (+ 1250us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:56.247770 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 06:15:56.247972 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2778,"thread_start_us":100,"threads_started":1}
I20260812 06:15:56.248960 25398 heartbeater.cc:347] Connected to a master server at 127.0.176.254:42259
I20260812 06:15:56.249079 25398 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:56.249327 25398 heartbeater.cc:511] Master 127.0.176.254:42259 requested a full tablet report, sending...
I20260812 06:15:56.250214 25104 ts_manager.cc:194] Registered new tserver with Master: 0d690cefcd18454880ee25f18651d267 (127.0.176.193:41581)
I20260812 06:15:56.251449 25104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:49037
I20260812 06:15:56.252699 25398 heartbeater.cc:503] Master 127.0.176.254:42259 was elected leader, sending a full tablet report...
I20260812 06:15:56.257155 25416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.251038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48544 (local address 127.0.176.193:41581)
0812 06:15:56.252999 (+ 1961us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:56.253005 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:56.253017 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:15:56.253062 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:56.253064 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:56.253081 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:56.253177 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:56.253422 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.254107 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.255942 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.256627 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.256720 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.256768 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:56.257048 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 06:15:56.257092 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1919,"thread_start_us":84,"threads_started":1}
I20260812 06:15:56.257155 25413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.250939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:41581 (local address 127.0.0.1:48544)
0812 06:15:56.251155 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:56.251198 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:56.251275 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:56.253216 (+ 1941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:56.253228 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:56.253233 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:56.253325 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.253329 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.254204 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.254205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.255739 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.255744 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.256757 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.256759 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.256877 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.256899 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 06:15:56.256989 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 06:15:56.257058 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":121,"threads_started":1}
I20260812 06:15:56.257761 25296 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cecb8e809174460b9564856c8ec9bda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:15:55 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:48544
I20260812 06:15:56.258365 25417 tablet_replica.cc:330] stopping tablet replica
I20260812 06:15:56.258491 25417 raft_consensus.cc:2229] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:15:56.258564 25417 raft_consensus.cc:2258] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:15:56.259071 25417 ts_tablet_manager.cc:1905] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:15:56.261552 25417 ts_tablet_manager.cc:1918] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:15:56.261655 25417 log.cc:1196] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal/wals/3cecb8e809174460b9564856c8ec9bda
I20260812 06:15:56.261901 25417 ts_tablet_manager.cc:1939] T 3cecb8e809174460b9564856c8ec9bda P 0d690cefcd18454880ee25f18651d267: Deleting consensus metadata
I20260812 06:15:56.262559 25079 catalog_manager.cc:4841] TS 0d690cefcd18454880ee25f18651d267 (127.0.176.193:41581): tablet 3cecb8e809174460b9564856c8ec9bda (table test-table [id=ee0ae9ec4f4d4946ad764c0dc7d56c19]) successfully deleted
W20260812 06:15:56.337446 25410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:56.337831 25410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:56.337888 25410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:56.339278 25410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:56.339351 25410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:56.339421 25410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:15:56.341111 25410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:34267
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=42845
--tserver_master_addrs=127.0.176.254:42259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:56.341370 25410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:56.341590 25410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:56.347440 25426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:56.347440 25424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:56.347687 25423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:56.347739 25410 server_base.cc:1034] running on GCE node
I20260812 06:15:56.348067 25410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:56.348371 25410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:56.349553 25410 hybrid_clock.cc:648] HybridClock initialized: now 1786515356349545 us; error 49 us; skew 500 ppm
Aug 12 06:15:56 dist-test-slave-gw5c krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515356, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:56.352532 25410 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:15:56.353034 25410 webserver.cc:460] Webserver started at http://127.0.176.194:42845/ using document root <none> and password file <none>
I20260812 06:15:56.353324 25410 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:56.353434 25410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:56.354951 25410 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:15:56.355834 25436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:56.356081 25410 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:56.356227 25410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "ea5d98c2d03749b98354377ac0fb7beb"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "c522ae634c7e43549020d6f53220e492"
server_key_iv: "941c0508c710465cd08752e215779f93"
server_key_version: "encryptionkey@0"
I20260812 06:15:56.356664 25410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:56.368211 25410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:56.370239 25410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:56.370441 25410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:56.370714 25410 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:56.371165 25410 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:15:56.371223 25410 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:56.371266 25410 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:15:56.371295 25410 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:56.377636 25410 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:34267
I20260812 06:15:56.377692 25614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:34267 every 8 connection(s)
I20260812 06:15:56.378068 25410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:15:56.380764 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 25410
I20260812 06:15:56.381088 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:35839
--local_ip_for_outbound_sockets=127.0.176.195
--tserver_master_addrs=127.0.176.254:42259
--webserver_port=43543
--webserver_interface=127.0.176.195
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:15:56 dist-test-slave-gw5c krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515356, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:56.389261 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.378851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:45655 (local address 127.0.176.254:42259)
0812 06:15:56.378935 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:56.378937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:56.379172 (+ 235us) server_negotiation.cc:407] Connection header received
0812 06:15:56.379772 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:56.379774 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:56.379792 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:56.379857 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:56.380953 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.381699 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.382774 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.382993 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.383077 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.385878 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:56.385884 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:56.385884 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:56.385891 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:56.387675 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:56.388162 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:56.388164 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:56.388164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:56.388232 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:56.388516 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:56.388517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:56.388517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:56.388654 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:56.388729 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:56.389048 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 06:15:56.389160 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:15:56.389477 25618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.378836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:45655)
0812 06:15:56.379038 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:56.379078 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:56.379654 (+ 576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:56.379942 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:56.379946 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:56.380588 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:56.380800 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.380805 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.381810 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.381810 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.382664 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.382667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.383088 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.383089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.383233 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.383914 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:56.383924 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:56.385757 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:56.387786 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:56.387796 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:56.387798 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:56.388062 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:56.388303 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:56.388304 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:56.388304 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:56.388443 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:56.388731 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:56.388740 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:56.388905 (+ 165us) client_negotiation.cc:769] Sending connection context
0812 06:15:56.389024 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 06:15:56.389207 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":91,"threads_started":1}
I20260812 06:15:56.390067 25615 heartbeater.cc:347] Connected to a master server at 127.0.176.254:42259
I20260812 06:15:56.390199 25615 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:56.390452 25615 heartbeater.cc:511] Master 127.0.176.254:42259 requested a full tablet report, sending...
I20260812 06:15:56.390931 25104 ts_manager.cc:194] Registered new tserver with Master: ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194:34267)
I20260812 06:15:56.391348 25104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:45655
W20260812 06:15:56.470801 25619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:56.471048 25619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:56.471076 25619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:56.472298 25619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:56.472342 25619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:56.472369 25619 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:15:56.473954 25619 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:35839
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=43543
--tserver_master_addrs=127.0.176.254:42259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:56.474192 25619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:56.474399 25619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:56.479920 25627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:56.480010 25619 server_base.cc:1034] running on GCE node
W20260812 06:15:56.479974 25626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:56.479874 25630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:56.480302 25619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:56.480579 25619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:56.481775 25619 hybrid_clock.cc:648] HybridClock initialized: now 1786515356481748 us; error 53 us; skew 500 ppm
Aug 12 06:15:56 dist-test-slave-gw5c krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515356, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:56.485105 25619 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:15:56.485711 25619 webserver.cc:460] Webserver started at http://127.0.176.195:43543/ using document root <none> and password file <none>
I20260812 06:15:56.486042 25619 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:56.486140 25619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:56.487802 25619 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:15:56.488492 25651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:56.488710 25619 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:56.488837 25619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "e1af24f5c3d243a286658584ff1c99bd"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "b6d80bcd8162ba8b1c0fa68e0d20d2c3"
server_key_iv: "af41872b430860032e9bb14e42c5a54e"
server_key_version: "encryptionkey@0"
I20260812 06:15:56.489231 25619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:56.512244 25619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:56.514816 25619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:56.515036 25619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:56.515311 25619 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:56.515684 25619 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:15:56.515744 25619 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:56.515781 25619 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:15:56.515829 25619 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:56.522423 25619 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:35839
I20260812 06:15:56.522477 25819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:35839 every 8 connection(s)
I20260812 06:15:56.522866 25619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:15:56.528702 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 25619
Aug 12 06:15:56 dist-test-slave-gw5c krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515356, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:15:56.533694 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.523680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:58273 (local address 127.0.176.254:42259)
0812 06:15:56.523781 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:56.523784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:56.523961 (+ 177us) server_negotiation.cc:407] Connection header received
0812 06:15:56.524476 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:56.524477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:56.524488 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:56.524543 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:56.525532 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.526030 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.527089 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.527290 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.527368 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.530147 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:56.530149 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:56.530150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:56.530160 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:56.531959 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:56.532522 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:56.532523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:56.532524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:56.532604 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:56.532954 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:56.532956 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:56.532956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:56.533092 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:56.533174 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:56.533495 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 06:15:56.533592 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 06:15:56.534126 25825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.523639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:58273)
0812 06:15:56.523826 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:56.523868 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:56.524385 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:56.524597 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:56.524600 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:56.525226 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:56.525445 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.525449 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.526120 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.526120 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.526929 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.526941 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.527441 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.527442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.527589 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.528191 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:56.528201 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:56.530041 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:56.532045 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:56.532058 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:56.532061 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:56.532438 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:56.532708 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:56.532709 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:56.532709 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:56.532848 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:56.533178 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:56.533186 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:56.533344 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 06:15:56.533461 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 06:15:56.533655 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":112,"threads_started":1}
I20260812 06:15:56.534793 25820 heartbeater.cc:347] Connected to a master server at 127.0.176.254:42259
I20260812 06:15:56.534910 25820 heartbeater.cc:464] Registering TS with master...
I20260812 06:15:56.535183 25820 heartbeater.cc:511] Master 127.0.176.254:42259 requested a full tablet report, sending...
I20260812 06:15:56.535707 25104 ts_manager.cc:194] Registered new tserver with Master: e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839)
I20260812 06:15:56.536113 25104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:58273
I20260812 06:15:56.537576 25826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.529223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36032 (local address 127.0.176.254:42259)
0812 06:15:56.529359 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:56.529361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:56.529474 (+ 113us) server_negotiation.cc:407] Connection header received
0812 06:15:56.529540 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:56.529541 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:56.529551 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:56.529613 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:56.530303 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.530806 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.532019 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.532327 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.532416 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.533799 (+ 1383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:56.533801 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:56.533801 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:56.533809 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:56.535804 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:56.536195 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:56.536196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:56.536197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:56.536263 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:56.536949 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:56.536950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:56.536951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:56.537068 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:56.537276 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:56.537347 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 06:15:56.537455 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":80,"threads_started":1}
I20260812 06:15:56.538509 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:15:56.541795 25826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.538944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36046 (local address 127.0.176.254:42259)
0812 06:15:56.539017 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:56.539019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:56.539129 (+ 110us) server_negotiation.cc:407] Connection header received
0812 06:15:56.539212 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:56.539213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:56.539258 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:56.539345 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:15:56.539496 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.540010 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.540903 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.541133 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.541216 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.541418 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:15:56.541544 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:15:56.541647 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:56.541664 (+ 17us) server_negotiation.cc:299] Negotiation successful
0812 06:15:56.541696 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 06:15:56.542157 25104 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:36046:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:15:56.544023 25104 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:15:56.546962 25296 tablet_service.cc:1467] Processing CreateTablet for tablet c2d6e55606914e708b797f37fa550814 (DEFAULT_TABLE table=test-table [id=78f84670b832485987531b2296f7a96b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:15:56.547240 25296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2d6e55606914e708b797f37fa550814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:56.549271 25234 tablet_bootstrap.cc:492] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267: Bootstrap starting.
I20260812 06:15:56.549678 25234 tablet_bootstrap.cc:654] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:56.550384 25234 tablet_bootstrap.cc:492] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267: No bootstrap required, opened a new log
I20260812 06:15:56.550446 25234 ts_tablet_manager.cc:1397] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:56.550558 25234 raft_consensus.cc:348] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:15:56.550616 25833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.546348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:34267 (local address 127.0.0.1:39372)
0812 06:15:56.546503 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:56.546515 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:56.546639 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:56.546989 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:56.546991 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:56.546993 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:56.547058 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.547060 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.548209 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.548211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.549095 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.549099 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.550323 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.550324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.550394 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.550398 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:15:56.550482 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 06:15:56.550533 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":27,"thread_start_us":83,"threads_started":1}
I20260812 06:15:56.550642 25234 raft_consensus.cc:374] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:56.550701 25234 raft_consensus.cc:729] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d690cefcd18454880ee25f18651d267, State: Initialized, Role: FOLLOWER
I20260812 06:15:56.550760 25234 consensus_queue.cc:260] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:15:56.550853 25234 ts_tablet_manager.cc:1428] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 06:15:56.550976 25834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.546614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39372 (local address 127.0.176.194:34267)
0812 06:15:56.546829 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:56.546833 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:56.546842 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:15:56.546877 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:56.546879 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:56.546894 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:56.546991 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:56.547121 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.548067 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.549215 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.550218 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.550304 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.550373 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:56.550824 (+ 451us) server_negotiation.cc:299] Negotiation successful
0812 06:15:56.550877 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":111,"threads_started":1}
I20260812 06:15:56.551832 25503 tablet_service.cc:1467] Processing CreateTablet for tablet c2d6e55606914e708b797f37fa550814 (DEFAULT_TABLE table=test-table [id=78f84670b832485987531b2296f7a96b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:15:56.552214 25503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2d6e55606914e708b797f37fa550814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:56.553409 25413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.546348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:35839 (local address 127.0.0.1:36432)
0812 06:15:56.546412 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:56.546427 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:56.546485 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:56.549776 (+ 3291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:56.549778 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:56.549781 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:56.549834 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.549835 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.551394 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.551395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.552246 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.552249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.553147 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.553148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.553216 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.553221 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:15:56.553275 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:15:56.553336 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 06:15:56.553453 25836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.546847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36432 (local address 127.0.176.195:35839)
0812 06:15:56.549555 (+ 2708us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:56.549561 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:56.549574 (+ 13us) server_negotiation.cc:407] Connection header received
0812 06:15:56.549620 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:56.549622 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:56.549641 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:56.549925 (+ 284us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:56.550002 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.551024 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.552349 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.553037 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.553142 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.553207 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:56.553323 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 06:15:56.553368 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2565,"thread_start_us":92,"threads_started":1}
I20260812 06:15:56.554235 25713 tablet_service.cc:1467] Processing CreateTablet for tablet c2d6e55606914e708b797f37fa550814 (DEFAULT_TABLE table=test-table [id=78f84670b832485987531b2296f7a96b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:15:56.554646 25713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2d6e55606914e708b797f37fa550814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:15:56.555912 25840 tablet_bootstrap.cc:492] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb: Bootstrap starting.
I20260812 06:15:56.556550 25840 tablet_bootstrap.cc:654] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:56.557121 25840 log.cc:824] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:56.557873 25842 tablet_bootstrap.cc:492] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd: Bootstrap starting.
I20260812 06:15:56.558194 25840 tablet_bootstrap.cc:492] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb: No bootstrap required, opened a new log
I20260812 06:15:56.558285 25840 ts_tablet_manager.cc:1397] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:15:56.558594 25842 tablet_bootstrap.cc:654] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd: Neither blocks nor log segments found. Creating new log.
I20260812 06:15:56.559628 25842 log.cc:824] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:56.560845 25842 tablet_bootstrap.cc:492] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd: No bootstrap required, opened a new log
I20260812 06:15:56.560948 25842 ts_tablet_manager.cc:1397] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 06:15:56.561230 25840 raft_consensus.cc:348] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:15:56.561445 25840 raft_consensus.cc:374] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:56.561483 25840 raft_consensus.cc:729] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5d98c2d03749b98354377ac0fb7beb, State: Initialized, Role: FOLLOWER
I20260812 06:15:56.561625 25840 consensus_queue.cc:260] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:15:56.562098 25840 ts_tablet_manager.cc:1428] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 06:15:56.562227 25615 heartbeater.cc:503] Master 127.0.176.254:42259 was elected leader, sending a full tablet report...
I20260812 06:15:56.563133 25842 raft_consensus.cc:348] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:15:56.563321 25842 raft_consensus.cc:374] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:15:56.563374 25842 raft_consensus.cc:729] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1af24f5c3d243a286658584ff1c99bd, State: Initialized, Role: FOLLOWER
I20260812 06:15:56.563550 25842 consensus_queue.cc:260] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:15:56.563832 25842 ts_tablet_manager.cc:1428] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260812 06:15:56.563871 25820 heartbeater.cc:503] Master 127.0.176.254:42259 was elected leader, sending a full tablet report...
W20260812 06:15:56.628674 25616 tablet.cc:2369] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:15:56.711879 25846 raft_consensus.cc:482] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:15:56.712062 25846 raft_consensus.cc:504] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:15:56.712492 25846 leader_election.cc:288] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839), 0d690cefcd18454880ee25f18651d267 (127.0.176.193:41581)
I20260812 06:15:56.715639 25618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.712709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:41581 (local address 127.0.176.194:58001)
0812 06:15:56.712776 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:56.712790 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:56.712845 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:56.713000 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:56.713002 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:56.713003 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:56.713084 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.713086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.713738 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.713739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.714488 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.714490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.715282 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.715283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.715408 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.715413 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:15:56.715474 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:15:56.715553 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 06:15:56.715956 25836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.712783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:60391 (local address 127.0.176.195:35839)
0812 06:15:56.712836 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:56.712838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:56.713005 (+ 167us) server_negotiation.cc:407] Connection header received
0812 06:15:56.713098 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:56.713099 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:56.713109 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:56.713185 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:56.713337 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.713805 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.714803 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.715427 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.715496 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.715506 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:56.715806 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 06:15:56.715864 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:15:56.715975 25416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.712801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:58001 (local address 127.0.176.193:41581)
0812 06:15:56.712853 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:56.712855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:56.712881 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:15:56.712913 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:56.712914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:56.712932 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:56.712997 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:15:56.713164 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.713642 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.714606 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.715191 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.715269 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.715280 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:56.715863 (+ 583us) server_negotiation.cc:299] Negotiation successful
0812 06:15:56.715911 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:15:56.716199 25848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.712722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:35839 (local address 127.0.176.194:60391)
0812 06:15:56.712928 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:56.712937 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:56.713020 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:56.713188 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:56.713189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:56.713191 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:15:56.713267 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.713269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.713913 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.713914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.714701 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:56.714704 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.715545 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.715548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:56.715626 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.715631 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:15:56.716043 (+ 412us) client_negotiation.cc:240] Negotiation successful
0812 06:15:56.716103 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":115,"threads_started":1}
I20260812 06:15:56.716305 25330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d6e55606914e708b797f37fa550814" candidate_uuid: "ea5d98c2d03749b98354377ac0fb7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d690cefcd18454880ee25f18651d267" is_pre_election: true
I20260812 06:15:56.716507 25330 raft_consensus.cc:2454] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5d98c2d03749b98354377ac0fb7beb in term 0.
I20260812 06:15:56.716943 25437 leader_election.cc:302] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d690cefcd18454880ee25f18651d267, ea5d98c2d03749b98354377ac0fb7beb; no voters:
I20260812 06:15:56.716934 25742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d6e55606914e708b797f37fa550814" candidate_uuid: "ea5d98c2d03749b98354377ac0fb7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1af24f5c3d243a286658584ff1c99bd" is_pre_election: true
I20260812 06:15:56.717103 25742 raft_consensus.cc:2454] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5d98c2d03749b98354377ac0fb7beb in term 0.
I20260812 06:15:56.717271 25846 raft_consensus.cc:2781] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:15:56.717336 25846 raft_consensus.cc:482] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:15:56.717376 25846 raft_consensus.cc:3037] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:56.718575 25846 raft_consensus.cc:504] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:15:56.719063 25846 leader_election.cc:288] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [CANDIDATE]: Term 1 election: Requested vote from peers e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839), 0d690cefcd18454880ee25f18651d267 (127.0.176.193:41581)
I20260812 06:15:56.719153 25330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d6e55606914e708b797f37fa550814" candidate_uuid: "ea5d98c2d03749b98354377ac0fb7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d690cefcd18454880ee25f18651d267"
I20260812 06:15:56.719247 25742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d6e55606914e708b797f37fa550814" candidate_uuid: "ea5d98c2d03749b98354377ac0fb7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1af24f5c3d243a286658584ff1c99bd"
I20260812 06:15:56.719262 25330 raft_consensus.cc:3037] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:56.719333 25742 raft_consensus.cc:3037] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:15:56.720355 25742 raft_consensus.cc:2454] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5d98c2d03749b98354377ac0fb7beb in term 1.
I20260812 06:15:56.720618 25439 leader_election.cc:302] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1af24f5c3d243a286658584ff1c99bd, ea5d98c2d03749b98354377ac0fb7beb; no voters:
I20260812 06:15:56.720709 25330 raft_consensus.cc:2454] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5d98c2d03749b98354377ac0fb7beb in term 1.
I20260812 06:15:56.720757 25846 raft_consensus.cc:2781] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:15:56.720947 25846 raft_consensus.cc:686] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [term 1 LEADER]: Becoming Leader. State: Replica: ea5d98c2d03749b98354377ac0fb7beb, State: Running, Role: LEADER
I20260812 06:15:56.721060 25846 consensus_queue.cc:237] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:15:56.722054 25104 catalog_manager.cc:5495] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb reported cstate change: term changed from 0 to 1, leader changed from <none> to ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194). New cstate: current_term: 1 leader_uuid: "ea5d98c2d03749b98354377ac0fb7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } health_report { overall_health: UNKNOWN } } }
W20260812 06:15:56.732800 25399 tablet.cc:2369] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:15:56.737711 25834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:56.735443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39378 (local address 127.0.176.194:34267)
0812 06:15:56.735514 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:56.735516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:56.735525 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:15:56.735571 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:56.735571 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:56.735589 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:56.735654 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:15:56.735763 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.736243 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.736982 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:56.737169 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:56.737225 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:56.737355 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:15:56.737461 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:15:56.737523 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:56.737552 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 06:15:56.737570 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 06:15:56.739707 25742 raft_consensus.cc:1261] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd [term 1 FOLLOWER]: Refusing update from remote peer ea5d98c2d03749b98354377ac0fb7beb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:15:56.739732 25330 raft_consensus.cc:1261] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Refusing update from remote peer ea5d98c2d03749b98354377ac0fb7beb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:15:56.740120 25850 consensus_queue.cc:1035] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:15:56.740270 25846 consensus_queue.cc:1035] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:15:56.742532 25853 mvcc.cc:205] Tried to move back new op lower bound from 7317566901202882560 to 7317566901130145792. Current Snapshot: MvccSnapshot[applied={T|T < 7317566901202882560}]
I20260812 06:15:56.742743 25854 mvcc.cc:205] Tried to move back new op lower bound from 7317566901202882560 to 7317566901130145792. Current Snapshot: MvccSnapshot[applied={T|T < 7317566901202882560}]
I20260812 06:15:56.745298 25102 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:36046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:15:56.745440 25102 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:36046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:15:56.746304 25102 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Sending DeleteTablet for 3 replicas of tablet c2d6e55606914e708b797f37fa550814
I20260812 06:15:56.746660 25503 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d6e55606914e708b797f37fa550814 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:15:56 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:39372
I20260812 06:15:56.746712 25296 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d6e55606914e708b797f37fa550814 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:15:56 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:48544
I20260812 06:15:56.746747 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 25160
I20260812 06:15:56.746737 25713 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d6e55606914e708b797f37fa550814 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:15:56 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:36432
I20260812 06:15:56.746815 25417 tablet_replica.cc:330] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267: stopping tablet replica
I20260812 06:15:56.746867 25417 raft_consensus.cc:2229] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:15:56.746922 25417 raft_consensus.cc:2258] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:15:56.752960 25868 tablet_replica.cc:330] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb: stopping tablet replica
I20260812 06:15:56.753137 25868 raft_consensus.cc:2229] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:15:56.753252 25868 raft_consensus.cc:2258] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:15:56.754957 25868 ts_tablet_manager.cc:1905] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:15:56.756857 25868 ts_tablet_manager.cc:1918] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:15:56.756937 25868 log.cc:1196] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/c2d6e55606914e708b797f37fa550814
I20260812 06:15:56.757195 25868 ts_tablet_manager.cc:1939] T c2d6e55606914e708b797f37fa550814 P ea5d98c2d03749b98354377ac0fb7beb: Deleting consensus metadata
I20260812 06:15:56.757652 25079 catalog_manager.cc:4841] TS ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194:34267): tablet c2d6e55606914e708b797f37fa550814 (table test-table [id=78f84670b832485987531b2296f7a96b]) successfully deleted
I20260812 06:15:56.764096 25869 tablet_replica.cc:330] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd: stopping tablet replica
I20260812 06:15:56.764292 25869 raft_consensus.cc:2229] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:15:56.764437 25869 raft_consensus.cc:2258] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:15:56.765050 25869 ts_tablet_manager.cc:1905] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 06:15:56.765609 25079 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:41581 (error 108)
W20260812 06:15:56.766481 25413 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:15:56.766104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:41581 (local address 127.0.0.1:48560)
0812 06:15:56.766173 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:56.766188 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:56.766264 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:56.766429 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:41581: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 06:15:56.766804 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 25410
W20260812 06:15:56.773393 25079 catalog_manager.cc:4584] TS 0d690cefcd18454880ee25f18651d267 (127.0.176.193:41581): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c2d6e55606914e708b797f37fa550814: Network error: Client connection negotiation failed: client connection to 127.0.176.193:41581: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:15:56.779650 25869 ts_tablet_manager.cc:1918] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:15:56.779803 25869 log.cc:1196] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/c2d6e55606914e708b797f37fa550814
I20260812 06:15:56.780144 25869 ts_tablet_manager.cc:1939] T c2d6e55606914e708b797f37fa550814 P e1af24f5c3d243a286658584ff1c99bd: Deleting consensus metadata
I20260812 06:15:56.780759 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 25619
I20260812 06:15:56.780742 25083 catalog_manager.cc:4841] TS e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839): tablet c2d6e55606914e708b797f37fa550814 (table test-table [id=78f84670b832485987531b2296f7a96b]) successfully deleted
I20260812 06:15:56.793467 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 25054
I20260812 06:15:56.806203 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42259
--webserver_interface=127.0.176.254
--webserver_port=41193
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:42259
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:56.893988 25872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:56.894237 25872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:56.894263 25872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:56.895752 25872 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:15:56.895807 25872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:56.895823 25872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:56.895835 25872 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:15:56.895848 25872 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:15:56.897496 25872 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:42259
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=41193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:56.897800 25872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:56.898069 25872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:56.903324 25882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:56.903326 25885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:56.903702 25880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:56.903832 25872 server_base.cc:1034] running on GCE node
I20260812 06:15:56.904127 25872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:56.904458 25872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:56.905655 25872 hybrid_clock.cc:648] HybridClock initialized: now 1786515356905638 us; error 49 us; skew 500 ppm
Aug 12 06:15:56 dist-test-slave-gw5c krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515356, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:56.908545 25872 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:15:56.909075 25872 webserver.cc:460] Webserver started at http://127.0.176.254:41193/ using document root <none> and password file <none>
I20260812 06:15:56.909312 25872 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:56.909382 25872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:56.910790 25872 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:56.911603 25895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:56.911790 25872 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:15:56.911921 25872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "4cbde3633afb486ebed237deccaf0f7b"
format_stamp: "Formatted at 2026-08-12 06:15:54 on dist-test-slave-gw5c"
server_key: "320bed6c16be9527deb63b0f29c19ab2"
server_key_iv: "c14d263407c96f7c8c33b3dec3fee124"
server_key_version: "encryptionkey@0"
I20260812 06:15:56.912293 25872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:56.930128 25872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:56.933203 25872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:56.933408 25872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:56.938472 25872 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:42259
I20260812 06:15:56.938575 25980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:42259 every 8 connection(s)
I20260812 06:15:56.938980 25872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:15:56.940891 25985 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:15:56.941553 25985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Bootstrap starting.
I20260812 06:15:56.942543 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 25872
I20260812 06:15:56.942896 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:41581
--local_ip_for_outbound_sockets=127.0.176.193
--tserver_master_addrs=127.0.176.254:42259
--webserver_port=33651
--webserver_interface=127.0.176.193
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:15:56.951879 25985 log.cc:824] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:56.954275 25985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:15:56.954629 25985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b: Bootstrap complete.
I20260812 06:15:56.957091 25985 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } }
I20260812 06:15:56.957365 25985 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cbde3633afb486ebed237deccaf0f7b, State: Initialized, Role: FOLLOWER
I20260812 06:15:56.957574 25985 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } }
I20260812 06:15:56.957665 25985 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:15:56.957729 25985 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:15:56.957783 25985 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:15:56.958819 25985 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } }
I20260812 06:15:56.958945 25985 leader_election.cc:302] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cbde3633afb486ebed237deccaf0f7b; no voters:
I20260812 06:15:56.959179 25985 leader_election.cc:288] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 06:15:56.959220 25992 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:15:56.959363 25992 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [term 3 LEADER]: Becoming Leader. State: Replica: 4cbde3633afb486ebed237deccaf0f7b, State: Running, Role: LEADER
I20260812 06:15:56.959481 25992 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } }
I20260812 06:15:56.959509 25985 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:15:56.959771 25992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cbde3633afb486ebed237deccaf0f7b. Latest consensus state: current_term: 3 leader_uuid: "4cbde3633afb486ebed237deccaf0f7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } } }
I20260812 06:15:56.959860 25992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:56.959774 25993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "4cbde3633afb486ebed237deccaf0f7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cbde3633afb486ebed237deccaf0f7b" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42259 } } }
I20260812 06:15:56.960047 25993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cbde3633afb486ebed237deccaf0f7b [sys.catalog]: This master's current role is: LEADER
I20260812 06:15:56.960136 25997 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:15:56.961056 25997 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:15:56.961189 25997 catalog_manager.cc:1259] Loaded cluster ID: 02977f2b587441f0bfcad08248201824
I20260812 06:15:56.961403 25997 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 06:15:56.961798 25997 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc97222e9ad google::LogMessage::Fail() at ??:0
@ 0x7fc97223188a google::LogMessage::SendToLog() at ??:0
@ 0x7fc97222e4de google::LogMessage::Flush() at ??:0
@ 0x7fc97222fa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc97a14f0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fc97a1588b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc9740fc0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc9740f1954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc974f556db start_thread at ??:0
@ 0x7fc970d2c61f clone at ??:0
W20260812 06:15:57.052513 25987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:57.052837 25987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:57.052879 25987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:57.054884 25987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:57.054982 25987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:57.055032 25987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:15:57.057703 25987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:41581
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=33651
--tserver_master_addrs=127.0.176.254:42259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:57.058046 25987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:57.058353 25987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:57.064364 26040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:57.064393 26038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:57.064380 26042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:57.064828 25987 server_base.cc:1034] running on GCE node
I20260812 06:15:57.065078 25987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:57.065369 25987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:57.066568 25987 hybrid_clock.cc:648] HybridClock initialized: now 1786515357066551 us; error 34 us; skew 500 ppm
Aug 12 06:15:57 dist-test-slave-gw5c krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515357, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:57.069391 25987 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:15:57.069950 25987 webserver.cc:460] Webserver started at http://127.0.176.193:33651/ using document root <none> and password file <none>
I20260812 06:15:57.070212 25987 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:57.070284 25987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:57.072059 25987 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:15:57.072913 26052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:57.073115 25987 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:57.073232 25987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "0d690cefcd18454880ee25f18651d267"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "dddb576263051cfdc8457ba5bff566b1"
server_key_iv: "0c4547ecf1c967a9b464233e8a9bfad4"
server_key_version: "encryptionkey@0"
I20260812 06:15:57.073619 25987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:57.089732 25987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:57.092701 25987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:57.092908 25987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:57.093180 25987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:57.093679 26065 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 06:15:57.095827 25987 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:15:57.095929 25987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 06:15:57.095989 25987 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 06:15:57.096942 25987 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 06:15:57.097020 25987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 06:15:57.097081 26065 tablet_bootstrap.cc:492] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267: Bootstrap starting.
I20260812 06:15:57.104961 25987 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:41581
I20260812 06:15:57.105420 25987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:15:57.107661 26237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:41581 every 8 connection(s)
I20260812 06:15:57.110025 26065 log.cc:824] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267: Log is configured to *not* fsync() on all Append() calls
I20260812 06:15:57.111102 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 25987
I20260812 06:15:57.111465 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:34267
--local_ip_for_outbound_sockets=127.0.176.194
--tserver_master_addrs=127.0.176.254:42259
--webserver_port=42845
--webserver_interface=127.0.176.194
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:15:57.112955 26065 tablet_bootstrap.cc:492] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:15:57.113293 26065 tablet_bootstrap.cc:492] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267: Bootstrap complete.
I20260812 06:15:57.114640 26065 ts_tablet_manager.cc:1397] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.005s
I20260812 06:15:57.116178 26065 raft_consensus.cc:348] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:15:57.116528 26065 raft_consensus.cc:729] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d690cefcd18454880ee25f18651d267, State: Initialized, Role: FOLLOWER
I20260812 06:15:57.116708 26065 consensus_queue.cc:260] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:15:57.117039 26065 ts_tablet_manager.cc:1428] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260812 06:15:57.195209 26241 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:15:57.106246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:41919)
0812 06:15:57.106454 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:57.106492 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:57.106965 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:57.194962 (+ 87997us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":119,"threads_started":1}
W20260812 06:15:57.195525 26238 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:42259 (0 consecutive failures): Network error: Failed to ping master at 127.0.176.254:42259: Client connection negotiation failed: client connection to 127.0.176.254:42259: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:15:57.195915 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:57.195785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:45471)
0812 06:15:57.195846 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:57.195895 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 06:15:57.196278 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:57.196186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:37691)
0812 06:15:57.196235 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:57.196258 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 06:15:57.196398 26238 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:15:57.205060 26243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:57.205354 26243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:57.205403 26243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:57.206720 26243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:57.206800 26243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:57.206856 26243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:15:57.208691 26243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:34267
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=42845
--tserver_master_addrs=127.0.176.254:42259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:57.209019 26243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:57.209301 26243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:57.216547 26256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:57.216549 26253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:57.216549 26252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:57.217433 26243 server_base.cc:1034] running on GCE node
I20260812 06:15:57.217754 26243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:57.218019 26243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:57.219214 26243 hybrid_clock.cc:648] HybridClock initialized: now 1786515357219205 us; error 47 us; skew 500 ppm
Aug 12 06:15:57 dist-test-slave-gw5c krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515357, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:57.222334 26243 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:15:57.222904 26243 webserver.cc:460] Webserver started at http://127.0.176.194:42845/ using document root <none> and password file <none>
I20260812 06:15:57.223155 26243 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:57.223229 26243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:57.224807 26243 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:57.225688 26264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:57.225922 26243 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:57.226039 26243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "ea5d98c2d03749b98354377ac0fb7beb"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "c522ae634c7e43549020d6f53220e492"
server_key_iv: "941c0508c710465cd08752e215779f93"
server_key_version: "encryptionkey@0"
I20260812 06:15:57.226433 26243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:57.242965 26243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:57.245307 26243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:57.245504 26243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:57.245803 26243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:57.246150 26243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:15:57.246210 26243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:57.246255 26243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:15:57.246280 26243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:57.253293 26243 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:34267
I20260812 06:15:57.253334 26460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:34267 every 8 connection(s)
I20260812 06:15:57.253727 26243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:15:57.254956 26466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:57.254501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:42351)
0812 06:15:57.254721 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:57.254799 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":75,"threads_started":1}
W20260812 06:15:57.255472 26461 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:42259 (0 consecutive failures): Network error: Failed to ping master at 127.0.176.254:42259: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
I20260812 06:15:57.255980 26466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:57.255857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:39349)
0812 06:15:57.255921 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:57.255958 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 06:15:57.256366 26466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:57.256289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:59637)
0812 06:15:57.256330 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:57.256351 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 06:15:57.256490 26461 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:15:57.261386 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 26243
I20260812 06:15:57.261715 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:35839
--local_ip_for_outbound_sockets=127.0.176.195
--tserver_master_addrs=127.0.176.254:42259
--webserver_port=43543
--webserver_interface=127.0.176.195
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:15:57.351934 26470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:15:57.352182 26470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:15:57.352211 26470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:15:57.353526 26470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:15:57.353581 26470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:15:57.353612 26470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:15:57.355228 26470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:35839
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=43543
--tserver_master_addrs=127.0.176.254:42259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:15:57.355559 26470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:15:57.356252 26470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:15:57.361795 26480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:57.361830 26478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:15:57.361794 26477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:15:57.362232 26470 server_base.cc:1034] running on GCE node
I20260812 06:15:57.362478 26470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:15:57.362774 26470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:15:57.363962 26470 hybrid_clock.cc:648] HybridClock initialized: now 1786515357363947 us; error 38 us; skew 500 ppm
Aug 12 06:15:57 dist-test-slave-gw5c krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515357, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:15:57.366976 26470 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:15:57.367566 26470 webserver.cc:460] Webserver started at http://127.0.176.195:43543/ using document root <none> and password file <none>
I20260812 06:15:57.367897 26470 fs_manager.cc:359] Metadata directory not provided
I20260812 06:15:57.367971 26470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:15:57.369406 26470 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:15:57.370208 26488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:57.370441 26470 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:15:57.370550 26470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "e1af24f5c3d243a286658584ff1c99bd"
format_stamp: "Formatted at 2026-08-12 06:15:55 on dist-test-slave-gw5c"
server_key: "b6d80bcd8162ba8b1c0fa68e0d20d2c3"
server_key_iv: "af41872b430860032e9bb14e42c5a54e"
server_key_version: "encryptionkey@0"
I20260812 06:15:57.371183 26470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:15:57.398897 26470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:15:57.401535 26470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:15:57.401750 26470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:15:57.402055 26470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:15:57.402406 26470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:15:57.402463 26470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:57.402505 26470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:15:57.402549 26470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:15:57.409231 26470 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:35839
I20260812 06:15:57.409279 26668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:35839 every 8 connection(s)
I20260812 06:15:57.409667 26470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:15:57.410820 26674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:57.410345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:42799)
0812 06:15:57.410556 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:57.410643 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":92,"threads_started":1}
W20260812 06:15:57.411283 26669 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:42259 (0 consecutive failures): Network error: Failed to ping master at 127.0.176.254:42259: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
I20260812 06:15:57.411684 26674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:57.411556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:57501)
0812 06:15:57.411616 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:57.411648 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 06:15:57.412002 26674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:57.411909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:53839)
0812 06:15:57.411956 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:57.411980 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 06:15:57.412125 26669 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:15:57.418846 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 26470
I20260812 06:15:58.197150 26677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:58.196882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:44681)
0812 06:15:58.197033 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:58.197081 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":72,"threads_started":1}
I20260812 06:15:58.257195 26678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:58.256909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:38017)
0812 06:15:58.257093 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:58.257134 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":66,"threads_started":1}
I20260812 06:15:58.412755 26679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:58.412520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:35021)
0812 06:15:58.412657 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:58.412700 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
I20260812 06:15:58.809556 26680 raft_consensus.cc:482] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:15:58.809681 26680 raft_consensus.cc:504] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:15:58.809985 26680 leader_election.cc:288] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194:34267), e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839)
Aug 12 06:15:58 dist-test-slave-gw5c krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515357, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.195@KRBTEST.COM
Aug 12 06:15:58 dist-test-slave-gw5c krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515357, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.194@KRBTEST.COM
I20260812 06:15:58.821257 26686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:58.810407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:37431 (local address 127.0.176.194:34267)
0812 06:15:58.810546 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:58.810555 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:58.810574 (+ 19us) server_negotiation.cc:407] Connection header received
0812 06:15:58.811008 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:58.811010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:58.811051 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:58.811196 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:58.812090 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:58.813140 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:58.814115 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:58.814537 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:58.814686 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:58.817491 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:58.817496 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:58.817496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:58.817509 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:58.819417 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:58.819814 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:58.819818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:58.819818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:58.819926 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:58.820235 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:58.820236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:58.820237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:58.820587 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:58.820673 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:58.820993 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 06:15:58.821138 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":65,"threads_started":1}
I20260812 06:15:58.821257 26685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:58.810297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:34783 (local address 127.0.176.195:35839)
0812 06:15:58.810489 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 06:15:58.810502 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 06:15:58.810543 (+ 41us) server_negotiation.cc:407] Connection header received
0812 06:15:58.811008 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:15:58.811010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:15:58.811051 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:15:58.811219 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:15:58.812085 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:58.813049 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:58.814149 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:15:58.814537 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:15:58.814678 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:58.817194 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:15:58.817199 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:15:58.817200 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:15:58.817211 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:15:58.819411 (+ 2200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:58.820126 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:58.820128 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:58.820128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:58.820240 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:15:58.820452 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:15:58.820454 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:15:58.820454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:15:58.820733 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:15:58.820801 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 06:15:58.820992 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 06:15:58.821138 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":68,"threads_started":1}
I20260812 06:15:58.821321 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:58.810165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:34267 (local address 127.0.176.193:37431)
0812 06:15:58.810316 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:58.810327 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:58.810393 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:58.811260 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:58.811263 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:58.811763 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:58.811953 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:58.811959 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:58.813255 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:58.813256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:58.814016 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:58.814018 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:58.814673 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:58.814675 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:58.814760 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:58.815460 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:58.815465 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:58.817376 (+ 1911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:58.819491 (+ 2115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:58.819498 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:58.819500 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:58.819724 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:58.820033 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:58.820034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:58.820034 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:58.820167 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:58.820661 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:58.820667 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:58.820808 (+ 141us) client_negotiation.cc:769] Sending connection context
0812 06:15:58.820926 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 06:15:58.821149 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":36,"thread_start_us":60,"threads_started":1}
I20260812 06:15:58.821919 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:58.810166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:35839 (local address 127.0.176.193:34783)
0812 06:15:58.810314 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:58.810327 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:15:58.810393 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:15:58.811260 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:15:58.811263 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:15:58.811757 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:15:58.811953 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:58.811959 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:58.813180 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:58.813181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:58.814023 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:15:58.814026 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:15:58.814642 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:15:58.814643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:15:58.814758 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:15:58.815433 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:15:58.815443 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:15:58.817063 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:15:58.819809 (+ 2746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:58.819809 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:58.819809 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:58.820040 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:58.820313 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:15:58.820314 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:15:58.820314 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:15:58.820387 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:15:58.820810 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:15:58.820810 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:15:58.820845 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 06:15:58.820926 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 06:15:58.821204 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":216,"thread_start_us":73,"threads_started":1}
W20260812 06:15:58.822153 26057 leader_election.cc:341] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194:34267): Not found: Tablet not found: c2d6e55606914e708b797f37fa550814
W20260812 06:15:58.822620 26058 leader_election.cc:341] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839): Not found: Tablet not found: c2d6e55606914e708b797f37fa550814
I20260812 06:15:58.822674 26058 leader_election.cc:302] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d690cefcd18454880ee25f18651d267; no voters: e1af24f5c3d243a286658584ff1c99bd, ea5d98c2d03749b98354377ac0fb7beb
I20260812 06:15:58.822844 26680 raft_consensus.cc:2726] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:15:59.198168 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:59.197972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:60285)
0812 06:15:59.198069 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:59.198123 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 06:15:59.258155 26688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:59.257879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:42953)
0812 06:15:59.258047 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:59.258099 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":84,"threads_started":1}
I20260812 06:15:59.413499 26691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:15:59.413240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:35467)
0812 06:15:59.413409 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 06:15:59.413450 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":66,"threads_started":1}
I20260812 06:16:00.199285 26692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:00.198947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:35419)
0812 06:16:00.199172 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:00.199228 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":107,"threads_started":1}
I20260812 06:16:00.258983 26693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:00.258754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:60903)
0812 06:16:00.258887 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:00.258919 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
I20260812 06:16:00.414366 26694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:00.414098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:54763)
0812 06:16:00.414268 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:00.414316 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":70,"threads_started":1}
I20260812 06:16:00.667773 26696 raft_consensus.cc:482] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:16:00.667904 26696 raft_consensus.cc:504] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:16:00.668102 26696 leader_election.cc:288] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194:34267), e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839)
W20260812 06:16:00.668576 26057 leader_election.cc:341] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194:34267): Not found: Tablet not found: c2d6e55606914e708b797f37fa550814
W20260812 06:16:00.668663 26058 leader_election.cc:341] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839): Not found: Tablet not found: c2d6e55606914e708b797f37fa550814
I20260812 06:16:00.668743 26058 leader_election.cc:302] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d690cefcd18454880ee25f18651d267; no voters: e1af24f5c3d243a286658584ff1c99bd, ea5d98c2d03749b98354377ac0fb7beb
I20260812 06:16:00.668838 26696 raft_consensus.cc:2726] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:16:01.200186 26699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:01.199899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:59593)
0812 06:16:01.200075 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:01.200120 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":93,"threads_started":1}
I20260812 06:16:01.259780 26700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:01.259518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:46589)
0812 06:16:01.259665 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:01.259718 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":55,"threads_started":1}
I20260812 06:16:01.415243 26701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:01.414972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:59715)
0812 06:16:01.415130 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:01.415180 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":70,"threads_started":1}
I20260812 06:16:02.201385 26702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:02.201063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:60283)
0812 06:16:02.201266 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:02.201328 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":88,"threads_started":1}
I20260812 06:16:02.261020 26703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:02.260549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:43615)
0812 06:16:02.260928 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:02.260972 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":304,"threads_started":1}
I20260812 06:16:02.416105 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:02.415801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:47549)
0812 06:16:02.415992 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:02.416048 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":72,"threads_started":1}
I20260812 06:16:03.202263 26707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:03.202021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:60759)
0812 06:16:03.202163 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:03.202212 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
I20260812 06:16:03.261934 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:03.261674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:60613)
0812 06:16:03.261837 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:03.261882 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260812 06:16:03.417071 26709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:03.416794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:38805)
0812 06:16:03.416974 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:03.417022 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":73,"threads_started":1}
I20260812 06:16:03.902068 26710 raft_consensus.cc:482] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:16:03.902210 26710 raft_consensus.cc:504] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:16:03.902437 26710 leader_election.cc:288] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194:34267), e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839)
W20260812 06:16:03.902942 26057 leader_election.cc:341] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194:34267): Not found: Tablet not found: c2d6e55606914e708b797f37fa550814
W20260812 06:16:03.903024 26058 leader_election.cc:341] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839): Not found: Tablet not found: c2d6e55606914e708b797f37fa550814
I20260812 06:16:03.903132 26058 leader_election.cc:302] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d690cefcd18454880ee25f18651d267; no voters: e1af24f5c3d243a286658584ff1c99bd, ea5d98c2d03749b98354377ac0fb7beb
I20260812 06:16:03.903225 26710 raft_consensus.cc:2726] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:16:04.203164 26711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:04.202887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:59863)
0812 06:16:04.203060 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:04.203109 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":116,"threads_started":1}
I20260812 06:16:04.262743 26713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:04.262504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:57519)
0812 06:16:04.262654 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:04.262693 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260812 06:16:04.417955 26716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:04.417688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:41705)
0812 06:16:04.417847 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:04.417896 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":78,"threads_started":1}
I20260812 06:16:05.203959 26718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:05.203729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:59701)
0812 06:16:05.203863 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:05.203907 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260812 06:16:05.263556 26719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:05.263200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:38963)
0812 06:16:05.263448 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:05.263505 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":67,"threads_started":1}
I20260812 06:16:05.418921 26723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:05.418584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:33501)
0812 06:16:05.418816 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:05.418867 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":176,"threads_started":1}
I20260812 06:16:06.204952 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:06.204531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:45377)
0812 06:16:06.204802 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:06.204883 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":85,"threads_started":1}
I20260812 06:16:06.264549 26728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:06.264289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:52305)
0812 06:16:06.264458 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:06.264500 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":77,"threads_started":1}
I20260812 06:16:06.419903 26729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:06.419539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:35121)
0812 06:16:06.419803 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:06.419852 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":183,"threads_started":1}
I20260812 06:16:07.205886 26730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:07.205670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:47957)
0812 06:16:07.205799 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:07.205835 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":68,"threads_started":1}
I20260812 06:16:07.224431 26732 raft_consensus.cc:482] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:16:07.224536 26732 raft_consensus.cc:504] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5d98c2d03749b98354377ac0fb7beb" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34267 } } peers { permanent_uuid: "e1af24f5c3d243a286658584ff1c99bd" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 35839 } } peers { permanent_uuid: "0d690cefcd18454880ee25f18651d267" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 41581 } }
I20260812 06:16:07.224773 26732 leader_election.cc:288] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194:34267), e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839)
W20260812 06:16:07.225221 26057 leader_election.cc:341] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ea5d98c2d03749b98354377ac0fb7beb (127.0.176.194:34267): Not found: Tablet not found: c2d6e55606914e708b797f37fa550814
W20260812 06:16:07.225301 26058 leader_election.cc:341] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e1af24f5c3d243a286658584ff1c99bd (127.0.176.195:35839): Not found: Tablet not found: c2d6e55606914e708b797f37fa550814
I20260812 06:16:07.225391 26058 leader_election.cc:302] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d690cefcd18454880ee25f18651d267; no voters: e1af24f5c3d243a286658584ff1c99bd, ea5d98c2d03749b98354377ac0fb7beb
I20260812 06:16:07.225495 26732 raft_consensus.cc:2726] T c2d6e55606914e708b797f37fa550814 P 0d690cefcd18454880ee25f18651d267 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:16:07.265669 26735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:07.265315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:47217)
0812 06:16:07.265494 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:07.265541 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":97,"threads_started":1}
I20260812 06:16:07.420816 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:07.420490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:40099)
0812 06:16:07.420703 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:07.420752 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":102,"threads_started":1}
I20260812 06:16:08.206789 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:08.206519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:37903)
0812 06:16:08.206691 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:08.206739 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":98,"threads_started":1}
I20260812 06:16:08.266525 26740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:08.266293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:36517)
0812 06:16:08.266429 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:08.266476 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":69,"threads_started":1}
I20260812 06:16:08.421751 26742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:08.421480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:57241)
0812 06:16:08.421638 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:08.421688 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":70,"threads_started":1}
I20260812 06:16:09.207739 26744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:09.207485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:58581)
0812 06:16:09.207642 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:09.207690 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":66,"threads_started":1}
I20260812 06:16:09.267654 26745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:09.267205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:58343)
0812 06:16:09.267517 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:09.267574 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":77,"threads_started":1}
I20260812 06:16:09.422698 26746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:09.422416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:53959)
0812 06:16:09.422586 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:09.422645 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":71,"threads_started":1}
I20260812 06:16:10.208518 26748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:10.208257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:56191)
0812 06:16:10.208427 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:10.208468 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":67,"threads_started":1}
I20260812 06:16:10.268392 26750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:10.268162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:42895)
0812 06:16:10.268298 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:10.268344 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
I20260812 06:16:10.423580 26751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:10.423269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:46337)
0812 06:16:10.423488 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:10.423531 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":99,"threads_started":1}
I20260812 06:16:11.209491 26752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:11.209207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:59477)
0812 06:16:11.209390 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:11.209442 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":71,"threads_started":1}
I20260812 06:16:11.269178 26754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:11.268928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:59489)
0812 06:16:11.269086 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:11.269129 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":88,"threads_started":1}
I20260812 06:16:11.424665 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:11.424276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:35977)
0812 06:16:11.424522 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:11.424606 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":118,"threads_started":1}
I20260812 06:16:12.210523 26760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:12.210246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.193:56573)
0812 06:16:12.210435 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:12.210477 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":93,"threads_started":1}
I20260812 06:16:12.270174 26761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:12.269912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.194:44577)
0812 06:16:12.270078 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:12.270125 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":74,"threads_started":1}
I20260812 06:16:12.422729 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 25987
I20260812 06:16:12.434365 26762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:12.429102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42259 (local address 127.0.176.195:35463)
0812 06:16:12.434224 (+ 5122us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:12.434288 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:42259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5093,"thread_start_us":3386,"threads_started":1}
I20260812 06:16:12.455891 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 26243
I20260812 06:16:12.470582 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 26470
2026-08-12T06:16:12Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19015 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:16:12 dist-test-slave-gw5c krb5kdc[26766](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:16:12 dist-test-slave-gw5c krb5kdc[26766](info): set up 2 sockets
Aug 12 06:16:12 dist-test-slave-gw5c krb5kdc[26766](info): commencing operation
krb5kdc: starting...
W20260812 06:16:13.793579 707 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:16:13 dist-test-slave-gw5c krb5kdc[26766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:16:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:16:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:16:13.926317 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:36167
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:36167
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:16:14.013767 26784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:16:14.014050 26784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:16:14.014091 26784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:16:14.015288 26784 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 06:16:14.015367 26784 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 06:16:14.015388 26784 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 06:16:14.015403 26784 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:16:14.015447 26784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:16:14.015479 26784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:16:14.015504 26784 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:16:14.015533 26784 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:16:14.017107 26784 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:36167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:36167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:16:14.017416 26784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:16:14.017678 26784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:16:14.022917 26794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:14.023087 26790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:14.022895 26791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:14.023093 26784 server_base.cc:1034] running on GCE node
I20260812 06:16:14.023607 26784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:16:14.023948 26784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:16:14.025157 26784 hybrid_clock.cc:648] HybridClock initialized: now 1786515374025145 us; error 46 us; skew 500 ppm
Aug 12 06:16:14 dist-test-slave-gw5c krb5kdc[26766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515374, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:16:14.028151 26784 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:16:14.028731 26784 webserver.cc:460] Webserver started at http://127.0.176.254:39675/ using document root <none> and password file <none>
I20260812 06:16:14.029003 26784 fs_manager.cc:359] Metadata directory not provided
I20260812 06:16:14.029078 26784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:16:14.029235 26784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:16:14.030342 26784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "b0a3abd404a94a64b6946c92c4e2da37"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "079861779de2e6981b32b16d7fd98fa5"
server_key_iv: "44c20ec2a86dd4a7fd5910a16804a375"
server_key_version: "encryptionkey@0"
I20260812 06:16:14.030735 26784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "b0a3abd404a94a64b6946c92c4e2da37"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "079861779de2e6981b32b16d7fd98fa5"
server_key_iv: "44c20ec2a86dd4a7fd5910a16804a375"
server_key_version: "encryptionkey@0"
I20260812 06:16:14.032317 26784 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:16:14.033190 26805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:14.033391 26784 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:16:14.033507 26784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "b0a3abd404a94a64b6946c92c4e2da37"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "079861779de2e6981b32b16d7fd98fa5"
server_key_iv: "44c20ec2a86dd4a7fd5910a16804a375"
server_key_version: "encryptionkey@0"
I20260812 06:16:14.033591 26784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:16:14.065657 26784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:16:14.068441 26784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:16:14.068655 26784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:16:14.073316 26784 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:36167
I20260812 06:16:14.073365 26897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:36167 every 8 connection(s)
I20260812 06:16:14.073776 26784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:16:14.074776 26900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:16:14.077351 26900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Bootstrap starting.
I20260812 06:16:14.078027 26900 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Neither blocks nor log segments found. Creating new log.
I20260812 06:16:14.078361 26900 log.cc:824] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Log is configured to *not* fsync() on all Append() calls
I20260812 06:16:14.079262 26900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: No bootstrap required, opened a new log
I20260812 06:16:14.081008 26900 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } }
I20260812 06:16:14.081166 26900 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:16:14.081188 26900 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0a3abd404a94a64b6946c92c4e2da37, State: Initialized, Role: FOLLOWER
I20260812 06:16:14.081357 26900 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } }
I20260812 06:16:14.081436 26900 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:16:14.081481 26900 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:16:14.081532 26900 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:16:14.082154 26900 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } }
I20260812 06:16:14.082249 26900 leader_election.cc:302] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0a3abd404a94a64b6946c92c4e2da37; no voters:
I20260812 06:16:14.082458 26900 leader_election.cc:288] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:16:14.082512 26906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:16:14.082790 26906 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 1 LEADER]: Becoming Leader. State: Replica: b0a3abd404a94a64b6946c92c4e2da37, State: Running, Role: LEADER
I20260812 06:16:14.082787 26900 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:16:14.082989 26906 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } }
I20260812 06:16:14.083724 26910 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0a3abd404a94a64b6946c92c4e2da37. Latest consensus state: current_term: 1 leader_uuid: "b0a3abd404a94a64b6946c92c4e2da37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } } }
I20260812 06:16:14.083822 26910 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: This master's current role is: LEADER
I20260812 06:16:14.083890 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 26784
I20260812 06:16:14.083899 26909 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0a3abd404a94a64b6946c92c4e2da37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } } }
I20260812 06:16:14.083963 26909 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: This master's current role is: LEADER
I20260812 06:16:14.083994 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:16:14.084203 26921 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:16:14.084383 707 external_mini_cluster.cc:1428] Setting key 2db24b5db7c8ccb231189b4755f3a58f
I20260812 06:16:14.084764 26921 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:16:14.086815 26921 catalog_manager.cc:1347] Generated new cluster ID: 334a9a538c2342469dcfac3c185a4524
I20260812 06:16:14.086879 26921 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:16:14 dist-test-slave-gw5c krb5kdc[26766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:16:14.096114 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.085156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55512 (local address 127.0.176.254:36167)
0812 06:16:14.085558 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:14.085569 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:14.085602 (+ 33us) server_negotiation.cc:407] Connection header received
0812 06:16:14.085791 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:14.085800 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:14.085868 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:14.086023 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:16:14.086792 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.087884 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.088691 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.089155 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.089282 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.091863 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:16:14.091869 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:16:14.091869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:16:14.091884 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:16:14.094255 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:14.094688 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:14.094692 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:14.094692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:14.094796 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:14.095027 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:14.095028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:14.095028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:14.095320 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:16:14.095561 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:14.095708 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 06:16:14.095870 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":79,"threads_started":1}
I20260812 06:16:14.114699 26921 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:16:14.115288 26921 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:16:14.119093 26921 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Generated new TSK 0
I20260812 06:16:14.119318 26921 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:16:14.158699 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36167
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:16:14.283136 26948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:16:14.283375 26948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:16:14.283430 26948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:16:14.284729 26948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:16:14.284785 26948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:16:14.284814 26948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:16:14.286374 26948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:16:14.286604 26948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:16:14.286813 26948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:16:14.292147 26963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:14.292150 26969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:14.292168 26964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:14.292429 26948 server_base.cc:1034] running on GCE node
I20260812 06:16:14.292757 26948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:16:14.293040 26948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:16:14.294198 26948 hybrid_clock.cc:648] HybridClock initialized: now 1786515374294184 us; error 30 us; skew 500 ppm
Aug 12 06:16:14 dist-test-slave-gw5c krb5kdc[26766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515374, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:16:14.297289 26948 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:16:14.297984 26948 webserver.cc:460] Webserver started at http://127.0.176.193:37373/ using document root <none> and password file <none>
I20260812 06:16:14.298278 26948 fs_manager.cc:359] Metadata directory not provided
I20260812 06:16:14.298360 26948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:16:14.298520 26948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:16:14.299742 26948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "48d0fbf07cfa494185380f79add38d48"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "96083e92abe433737b554a2c524c33b0"
server_key_iv: "8f48ceb058f4d496f8db1a658136ee1f"
server_key_version: "encryptionkey@0"
I20260812 06:16:14.300112 26948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "48d0fbf07cfa494185380f79add38d48"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "96083e92abe433737b554a2c524c33b0"
server_key_iv: "8f48ceb058f4d496f8db1a658136ee1f"
server_key_version: "encryptionkey@0"
I20260812 06:16:14.301527 26948 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:16:14.302333 26981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:14.302531 26948 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:16:14.302703 26948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "48d0fbf07cfa494185380f79add38d48"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "96083e92abe433737b554a2c524c33b0"
server_key_iv: "8f48ceb058f4d496f8db1a658136ee1f"
server_key_version: "encryptionkey@0"
I20260812 06:16:14.302829 26948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:16:14.312493 26948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:16:14.314951 26948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:16:14.315132 26948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:16:14.315380 26948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:16:14.315769 26948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:16:14.315824 26948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:14.315862 26948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:16:14.315891 26948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:14.321982 26948 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:44499
I20260812 06:16:14.322033 27186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:44499 every 8 connection(s)
I20260812 06:16:14.322362 26948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:16:14.326498 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 26948
I20260812 06:16:14.326653 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:16:14.326882 707 external_mini_cluster.cc:1428] Setting key bc2214b881ce1959517f60067866199a
Aug 12 06:16:14 dist-test-slave-gw5c krb5kdc[26766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515374, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:16:14.333174 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.323151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:59145 (local address 127.0.176.254:36167)
0812 06:16:14.323218 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:14.323221 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:14.323450 (+ 229us) server_negotiation.cc:407] Connection header received
0812 06:16:14.323948 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:14.323949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:14.323966 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:14.324036 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:16:14.325027 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.325543 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.326602 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.326948 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.327035 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.330058 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:16:14.330060 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:16:14.330060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:16:14.330069 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:16:14.331626 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:14.332113 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:14.332115 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:14.332115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:14.332178 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:14.332462 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:14.332463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:14.332464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:14.332589 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:16:14.332667 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:14.332977 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 06:16:14.333075 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 06:16:14.333407 27189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.323097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:59145)
0812 06:16:14.323267 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:14.323311 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:14.323849 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:14.324090 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:14.324094 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:14.324706 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:16:14.324904 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.324908 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.325664 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.325665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.326485 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.326489 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.327061 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.327062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.327218 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.328127 (+ 909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:16:14.328136 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:16:14.329894 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:16:14.331734 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:14.331744 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:14.331746 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:14.332007 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:14.332252 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:14.332254 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:14.332254 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:14.332379 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:14.332657 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:16:14.332665 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:16:14.332824 (+ 159us) client_negotiation.cc:769] Sending connection context
0812 06:16:14.332954 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 06:16:14.333142 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
I20260812 06:16:14.334215 27187 heartbeater.cc:347] Connected to a master server at 127.0.176.254:36167
I20260812 06:16:14.334322 27187 heartbeater.cc:464] Registering TS with master...
I20260812 06:16:14.334535 27187 heartbeater.cc:511] Master 127.0.176.254:36167 requested a full tablet report, sending...
I20260812 06:16:14.335227 26833 ts_manager.cc:194] Registered new tserver with Master: 48d0fbf07cfa494185380f79add38d48 (127.0.176.193:44499)
I20260812 06:16:14.336174 26833 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:59145
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:16:14.355635 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36167
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:16:14.445580 27195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:16:14.445803 27195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:16:14.445829 27195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:16:14.446928 27195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:16:14.446966 27195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:16:14.446992 27195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:16:14.448431 27195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:16:14.448626 27195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:16:14.448825 27195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:16:14.453965 27202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:14.453958 27204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:14.454022 27201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:14.454335 27195 server_base.cc:1034] running on GCE node
I20260812 06:16:14.454564 27195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:16:14.454864 27195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:16:14.456044 27195 hybrid_clock.cc:648] HybridClock initialized: now 1786515374456030 us; error 29 us; skew 500 ppm
Aug 12 06:16:14 dist-test-slave-gw5c krb5kdc[26766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515374, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:16:14.458681 27195 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:16:14.459136 27195 webserver.cc:460] Webserver started at http://127.0.176.194:42139/ using document root <none> and password file <none>
I20260812 06:16:14.459364 27195 fs_manager.cc:359] Metadata directory not provided
I20260812 06:16:14.459465 27195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:16:14.459650 27195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:16:14.460718 27195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "c34af7aaa1724906adf4b25703b6a359"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "0a0b8560529b7da06b0c7437f113c52e"
server_key_iv: "62a59e5307c1de491e8c11edbbb854c5"
server_key_version: "encryptionkey@0"
I20260812 06:16:14.461093 27195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "c34af7aaa1724906adf4b25703b6a359"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "0a0b8560529b7da06b0c7437f113c52e"
server_key_iv: "62a59e5307c1de491e8c11edbbb854c5"
server_key_version: "encryptionkey@0"
I20260812 06:16:14.462599 27195 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:16:14.463551 27219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:14.463814 27195 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:16:14.463927 27195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "c34af7aaa1724906adf4b25703b6a359"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "0a0b8560529b7da06b0c7437f113c52e"
server_key_iv: "62a59e5307c1de491e8c11edbbb854c5"
server_key_version: "encryptionkey@0"
I20260812 06:16:14.464016 27195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:16:14.482117 27195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:16:14.485131 27195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:16:14.485329 27195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:16:14.485582 27195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:16:14.486014 27195 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:16:14.486053 27195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:14.486078 27195 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:16:14.486124 27195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:14.492347 27195 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:41023
I20260812 06:16:14.492443 27404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:41023 every 8 connection(s)
I20260812 06:16:14.492818 27195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:16:14 dist-test-slave-gw5c krb5kdc[26766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515374, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:16:14.502372 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 27195
I20260812 06:16:14.502525 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:16:14.502597 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.493697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:38193 (local address 127.0.176.254:36167)
0812 06:16:14.493784 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:14.493787 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:14.493982 (+ 195us) server_negotiation.cc:407] Connection header received
0812 06:16:14.494478 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:14.494479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:14.494489 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:14.494546 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:16:14.495612 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.496109 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.497148 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.497333 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.497388 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.499736 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:16:14.499738 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:16:14.499738 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:16:14.499746 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:16:14.501232 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:14.501669 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:14.501670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:14.501671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:14.501729 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:14.501964 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:14.501965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:14.501965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:14.502072 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:16:14.502124 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:14.502410 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 06:16:14.502504 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 06:16:14.502794 27410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.493639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:38193)
0812 06:16:14.493851 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:14.493891 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:14.494390 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:14.494603 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:14.494606 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:14.495219 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:16:14.495524 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.495529 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.496200 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.496201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.497058 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.497061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.497414 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.497415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.497525 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.498033 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:16:14.498041 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:16:14.499610 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:16:14.501333 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:14.501342 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:14.501344 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:14.501573 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:14.501796 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:14.501797 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:14.501797 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:14.501905 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:14.502127 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:16:14.502132 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:16:14.502249 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 06:16:14.502371 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 06:16:14.502539 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":117,"threads_started":1}
I20260812 06:16:14.502804 707 external_mini_cluster.cc:1428] Setting key 2021af4a78b1578a41265e1ddb39ef04
I20260812 06:16:14.503355 27405 heartbeater.cc:347] Connected to a master server at 127.0.176.254:36167
I20260812 06:16:14.503528 27405 heartbeater.cc:464] Registering TS with master...
I20260812 06:16:14.503757 27405 heartbeater.cc:511] Master 127.0.176.254:36167 requested a full tablet report, sending...
I20260812 06:16:14.504213 26832 ts_manager.cc:194] Registered new tserver with Master: c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023)
I20260812 06:16:14.504732 26832 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:38193
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:16:14.531229 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36167
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:16:14.622717 27413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:16:14.622931 27413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:16:14.622958 27413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:16:14.624099 27413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:16:14.624140 27413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:16:14.624167 27413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:16:14.625614 27413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:36167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:16:14.625837 27413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:16:14.626039 27413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:16:14.631273 27423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:14.631299 27420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:14.631533 27413 server_base.cc:1034] running on GCE node
W20260812 06:16:14.631273 27421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:14.631827 27413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:16:14.632088 27413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:16:14.633277 27413 hybrid_clock.cc:648] HybridClock initialized: now 1786515374633268 us; error 39 us; skew 500 ppm
Aug 12 06:16:14 dist-test-slave-gw5c krb5kdc[26766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515374, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:16:14.636046 27413 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:16:14.636595 27413 webserver.cc:460] Webserver started at http://127.0.176.195:44209/ using document root <none> and password file <none>
I20260812 06:16:14.636862 27413 fs_manager.cc:359] Metadata directory not provided
I20260812 06:16:14.636936 27413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:16:14.637095 27413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:16:14.638288 27413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "2f1880519c5a42c090b3d03a37a56b19"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "f62202627e83b2c5577dadc45d078226"
server_key_iv: "a7f61405cad9cb98c78e1eb4123d9639"
server_key_version: "encryptionkey@0"
I20260812 06:16:14.638667 27413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "2f1880519c5a42c090b3d03a37a56b19"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "f62202627e83b2c5577dadc45d078226"
server_key_iv: "a7f61405cad9cb98c78e1eb4123d9639"
server_key_version: "encryptionkey@0"
I20260812 06:16:14.640198 27413 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:16:14.641041 27439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:14.641247 27413 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:16:14.641356 27413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "2f1880519c5a42c090b3d03a37a56b19"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "f62202627e83b2c5577dadc45d078226"
server_key_iv: "a7f61405cad9cb98c78e1eb4123d9639"
server_key_version: "encryptionkey@0"
I20260812 06:16:14.641435 27413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:16:14.649827 27413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:16:14.652155 27413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:16:14.652345 27413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:16:14.652612 27413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:16:14.652940 27413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:16:14.652993 27413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:14.653033 27413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:16:14.653064 27413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:14.660822 27413 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:39057
I20260812 06:16:14.660926 27629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:39057 every 8 connection(s)
I20260812 06:16:14.661270 27413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:16:14.668149 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 27413
I20260812 06:16:14.668284 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
Aug 12 06:16:14 dist-test-slave-gw5c krb5kdc[26766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515374, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:16:14.668509 707 external_mini_cluster.cc:1428] Setting key dc08284854a998ef7d5787ee772da80c
I20260812 06:16:14.672027 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.662131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:58217 (local address 127.0.176.254:36167)
0812 06:16:14.662180 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:14.662182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:14.662396 (+ 214us) server_negotiation.cc:407] Connection header received
0812 06:16:14.662974 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:14.662976 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:14.662990 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:14.663044 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:16:14.664198 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.664721 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.665807 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.666024 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.666119 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.669160 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:16:14.669162 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:16:14.669162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:16:14.669169 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:16:14.670589 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:14.671046 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:14.671047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:14.671048 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:14.671105 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:14.671348 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:14.671349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:14.671349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:14.671537 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:16:14.671593 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:14.671875 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 06:16:14.671960 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:16:14.672261 27635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.662091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:58217)
0812 06:16:14.662247 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:14.662294 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:14.662846 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:14.663115 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:14.663120 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:14.663851 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:16:14.664069 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.664074 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.664841 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.664842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.665697 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.665700 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.666135 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.666136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.666270 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.666974 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:16:14.666984 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:16:14.669032 (+ 2048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:16:14.670693 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:14.670701 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:14.670703 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:14.670970 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:14.671168 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:14.671168 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:14.671169 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:14.671288 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:14.671614 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:16:14.671620 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:16:14.671753 (+ 133us) client_negotiation.cc:769] Sending connection context
0812 06:16:14.671850 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 06:16:14.671988 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":78,"threads_started":1}
I20260812 06:16:14.672765 27633 heartbeater.cc:347] Connected to a master server at 127.0.176.254:36167
I20260812 06:16:14.672883 27633 heartbeater.cc:464] Registering TS with master...
I20260812 06:16:14.673084 27633 heartbeater.cc:511] Master 127.0.176.254:36167 requested a full tablet report, sending...
I20260812 06:16:14.673496 26832 ts_manager.cc:194] Registered new tserver with Master: 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057)
I20260812 06:16:14.673864 26832 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:58217
I20260812 06:16:14.680815 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:16:14.689026 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.682302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34644 (local address 127.0.176.254:36167)
0812 06:16:14.682356 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:14.682359 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:14.682457 (+ 98us) server_negotiation.cc:407] Connection header received
0812 06:16:14.682527 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:14.682528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:14.682538 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:14.682583 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:16:14.683263 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.684031 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.684855 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.685042 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.685137 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.686464 (+ 1327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:16:14.686466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:16:14.686466 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:16:14.686472 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:16:14.687945 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:14.688279 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:14.688280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:14.688280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:14.688332 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:14.688496 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:14.688496 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:14.688496 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:14.688655 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:16:14.688728 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:14.688863 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 06:16:14.688933 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:16:14.690919 26832 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34644:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:16:14.692595 26832 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:16:14.700845 27648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.695177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44499 (local address 127.0.0.1:46218)
0812 06:16:14.695432 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:14.695483 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:14.695558 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:14.696260 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:14.696263 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:14.696266 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:16:14.696375 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.696378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.697573 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.697574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.699030 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.699033 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.700224 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.700225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.700334 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.700352 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 06:16:14.700637 (+ 285us) client_negotiation.cc:240] Negotiation successful
0812 06:16:14.700723 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":6,"thread_start_us":76,"threads_started":1}
I20260812 06:16:14.701407 27649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.695319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46218 (local address 127.0.176.193:44499)
0812 06:16:14.695767 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:14.695772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:14.695784 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:16:14.695829 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:14.695832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:14.695849 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:14.696293 (+ 444us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:16:14.696484 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.697432 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.699149 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.700107 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.700198 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.700259 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:14.701225 (+ 966us) server_negotiation.cc:299] Negotiation successful
0812 06:16:14.701300 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":137,"threads_started":1}
I20260812 06:16:14.701748 27650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.695216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:39057 (local address 127.0.0.1:33576)
0812 06:16:14.695581 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:14.695590 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:14.695634 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:14.698137 (+ 2503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:14.698138 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:14.698140 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:16:14.698190 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.698192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.699242 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.699243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.700304 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.700306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.701484 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.701485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.701549 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.701553 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:16:14.701607 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:16:14.701655 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":105,"threads_started":1}
I20260812 06:16:14.702131 27653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.695561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33576 (local address 127.0.176.195:39057)
0812 06:16:14.697970 (+ 2409us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:14.697975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:14.697985 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:16:14.698021 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:14.698023 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:14.698046 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:14.698137 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:16:14.698248 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.699133 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.700405 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.701308 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.701390 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.701447 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:14.701989 (+ 542us) server_negotiation.cc:299] Negotiation successful
0812 06:16:14.702048 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2363,"thread_start_us":84,"threads_started":1}
I20260812 06:16:14.702219 27652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.695531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37240 (local address 127.0.176.194:41023)
0812 06:16:14.697642 (+ 2111us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:14.697647 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:14.697655 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:16:14.697687 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:14.697689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:14.697703 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:14.697798 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:16:14.698001 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.699151 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.700860 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.701733 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.701796 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.701886 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:14.702089 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 06:16:14.702141 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2068,"thread_start_us":95,"threads_started":1}
I20260812 06:16:14.702170 27647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.695442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:41023 (local address 127.0.0.1:37240)
0812 06:16:14.695734 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:14.695747 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:14.695810 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:14.697820 (+ 2010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:14.697821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:14.697824 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:16:14.697884 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.697886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.699273 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.699274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.700554 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.700558 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.701920 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.701922 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.701985 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.701989 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:16:14.702050 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:16:14.702090 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":87,"threads_started":1}
I20260812 06:16:14.702385 27073 tablet_service.cc:1467] Processing CreateTablet for tablet 416448e09e034c009f5e9028d2ca5601 (DEFAULT_TABLE table=test-table [id=1abf0c7ceec4437596061685dcb4cace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:16:14.702839 27073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 416448e09e034c009f5e9028d2ca5601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:16:14.703133 27515 tablet_service.cc:1467] Processing CreateTablet for tablet 416448e09e034c009f5e9028d2ca5601 (DEFAULT_TABLE table=test-table [id=1abf0c7ceec4437596061685dcb4cace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:16:14.703256 27289 tablet_service.cc:1467] Processing CreateTablet for tablet 416448e09e034c009f5e9028d2ca5601 (DEFAULT_TABLE table=test-table [id=1abf0c7ceec4437596061685dcb4cace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:16:14.703523 27515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 416448e09e034c009f5e9028d2ca5601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:16:14.703634 27289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 416448e09e034c009f5e9028d2ca5601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:16:14.706583 27654 tablet_bootstrap.cc:492] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19: Bootstrap starting.
I20260812 06:16:14.706992 27657 tablet_bootstrap.cc:492] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359: Bootstrap starting.
I20260812 06:16:14.707494 27654 tablet_bootstrap.cc:654] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19: Neither blocks nor log segments found. Creating new log.
I20260812 06:16:14.707600 27656 tablet_bootstrap.cc:492] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Bootstrap starting.
I20260812 06:16:14.707782 27657 tablet_bootstrap.cc:654] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359: Neither blocks nor log segments found. Creating new log.
I20260812 06:16:14.708353 27656 tablet_bootstrap.cc:654] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Neither blocks nor log segments found. Creating new log.
I20260812 06:16:14.708424 27657 log.cc:824] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359: Log is configured to *not* fsync() on all Append() calls
I20260812 06:16:14.708429 27654 log.cc:824] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19: Log is configured to *not* fsync() on all Append() calls
I20260812 06:16:14.708987 27656 log.cc:824] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Log is configured to *not* fsync() on all Append() calls
I20260812 06:16:14.709291 27654 tablet_bootstrap.cc:492] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19: No bootstrap required, opened a new log
I20260812 06:16:14.709298 27657 tablet_bootstrap.cc:492] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359: No bootstrap required, opened a new log
I20260812 06:16:14.709378 27657 ts_tablet_manager.cc:1397] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:16:14.709404 27654 ts_tablet_manager.cc:1397] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 06:16:14.709865 27656 tablet_bootstrap.cc:492] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: No bootstrap required, opened a new log
I20260812 06:16:14.710000 27656 ts_tablet_manager.cc:1397] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:16:14.710916 27657 raft_consensus.cc:348] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } } peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } }
I20260812 06:16:14.711102 27657 raft_consensus.cc:374] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:16:14.711167 27657 raft_consensus.cc:729] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c34af7aaa1724906adf4b25703b6a359, State: Initialized, Role: FOLLOWER
I20260812 06:16:14.711308 27657 consensus_queue.cc:260] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } } peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } }
I20260812 06:16:14.711668 27657 ts_tablet_manager.cc:1428] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:16:14.711555 27654 raft_consensus.cc:348] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } } peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } }
I20260812 06:16:14.711688 27405 heartbeater.cc:503] Master 127.0.176.254:36167 was elected leader, sending a full tablet report...
I20260812 06:16:14.711726 27654 raft_consensus.cc:374] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:16:14.711760 27654 raft_consensus.cc:729] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f1880519c5a42c090b3d03a37a56b19, State: Initialized, Role: FOLLOWER
I20260812 06:16:14.711879 27654 consensus_queue.cc:260] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } } peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } }
I20260812 06:16:14.712172 27654 ts_tablet_manager.cc:1428] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 06:16:14.712414 27633 heartbeater.cc:503] Master 127.0.176.254:36167 was elected leader, sending a full tablet report...
I20260812 06:16:14.712342 27656 raft_consensus.cc:348] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } } peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } }
I20260812 06:16:14.712508 27656 raft_consensus.cc:374] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:16:14.712544 27656 raft_consensus.cc:729] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d0fbf07cfa494185380f79add38d48, State: Initialized, Role: FOLLOWER
I20260812 06:16:14.712653 27656 consensus_queue.cc:260] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } } peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } }
I20260812 06:16:14.712963 27656 ts_tablet_manager.cc:1428] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:16:14.713156 27187 heartbeater.cc:503] Master 127.0.176.254:36167 was elected leader, sending a full tablet report...
W20260812 06:16:14.743566 27409 tablet.cc:2369] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:16:14.794185 27667 raft_consensus.cc:482] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:16:14.794335 27667 raft_consensus.cc:504] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } } peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } }
I20260812 06:16:14.794713 27667 leader_election.cc:288] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023), 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057)
I20260812 06:16:14.797986 27652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.795200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:59409 (local address 127.0.176.194:41023)
0812 06:16:14.795278 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:14.795280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:14.795289 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:16:14.795316 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:14.795317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:14.795326 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:14.795383 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:16:14.795651 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.796151 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.797192 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.797594 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.797677 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.797688 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:14.797857 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 06:16:14.797897 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 06:16:14.797993 27653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.794986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:44209 (local address 127.0.176.195:39057)
0812 06:16:14.795059 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:14.795061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:14.795247 (+ 186us) server_negotiation.cc:407] Connection header received
0812 06:16:14.795287 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:14.795288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:14.795302 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:14.795381 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:16:14.795673 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.796143 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.797201 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.797600 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.797691 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.797700 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:14.797882 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 06:16:14.797923 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 06:16:14.798000 27189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.794886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:41023 (local address 127.0.176.193:59409)
0812 06:16:14.794948 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:14.794960 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:14.795002 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:14.795431 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:14.795432 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:14.795434 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:16:14.795543 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.795546 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.796264 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.796265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.797090 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.797093 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.797684 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.797685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.797775 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.797786 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 06:16:14.797859 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 06:16:14.797908 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":53}
I20260812 06:16:14.798008 27668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.794929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:39057 (local address 127.0.176.193:44209)
0812 06:16:14.795147 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:14.795158 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:14.795231 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:14.795431 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:14.795432 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:14.795434 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:16:14.795560 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.795561 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.796236 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.796237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.797094 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:14.797097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.797710 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.797711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:14.797786 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.797790 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:16:14.797863 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 06:16:14.797903 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":62,"thread_start_us":160,"threads_started":1}
I20260812 06:16:14.798403 27320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "416448e09e034c009f5e9028d2ca5601" candidate_uuid: "48d0fbf07cfa494185380f79add38d48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34af7aaa1724906adf4b25703b6a359" is_pre_election: true
I20260812 06:16:14.798610 27320 raft_consensus.cc:2454] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d0fbf07cfa494185380f79add38d48 in term 0.
I20260812 06:16:14.798651 27551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "416448e09e034c009f5e9028d2ca5601" candidate_uuid: "48d0fbf07cfa494185380f79add38d48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f1880519c5a42c090b3d03a37a56b19" is_pre_election: true
I20260812 06:16:14.798791 27551 raft_consensus.cc:2454] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d0fbf07cfa494185380f79add38d48 in term 0.
I20260812 06:16:14.798866 26989 leader_election.cc:302] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d0fbf07cfa494185380f79add38d48, c34af7aaa1724906adf4b25703b6a359; no voters:
I20260812 06:16:14.799052 27667 raft_consensus.cc:2781] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:16:14.799114 27667 raft_consensus.cc:482] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:16:14.799144 27667 raft_consensus.cc:3037] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:16:14.800189 27667 raft_consensus.cc:504] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } } peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } }
I20260812 06:16:14.800359 27667 leader_election.cc:288] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 1 election: Requested vote from peers c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023), 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057)
I20260812 06:16:14.800567 27551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "416448e09e034c009f5e9028d2ca5601" candidate_uuid: "48d0fbf07cfa494185380f79add38d48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f1880519c5a42c090b3d03a37a56b19"
I20260812 06:16:14.800573 27320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "416448e09e034c009f5e9028d2ca5601" candidate_uuid: "48d0fbf07cfa494185380f79add38d48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34af7aaa1724906adf4b25703b6a359"
I20260812 06:16:14.800678 27320 raft_consensus.cc:3037] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:16:14.800678 27551 raft_consensus.cc:3037] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:16:14.801647 27551 raft_consensus.cc:2454] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d0fbf07cfa494185380f79add38d48 in term 1.
I20260812 06:16:14.801647 27320 raft_consensus.cc:2454] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d0fbf07cfa494185380f79add38d48 in term 1.
I20260812 06:16:14.801843 26989 leader_election.cc:302] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d0fbf07cfa494185380f79add38d48, c34af7aaa1724906adf4b25703b6a359; no voters:
I20260812 06:16:14.801949 27667 raft_consensus.cc:2781] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:16:14.802109 27667 raft_consensus.cc:686] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 1 LEADER]: Becoming Leader. State: Replica: 48d0fbf07cfa494185380f79add38d48, State: Running, Role: LEADER
I20260812 06:16:14.802219 27667 consensus_queue.cc:237] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } } peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } }
I20260812 06:16:14.803169 26832 catalog_manager.cc:5495] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48d0fbf07cfa494185380f79add38d48 (127.0.176.193). New cstate: current_term: 1 leader_uuid: "48d0fbf07cfa494185380f79add38d48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } health_report { overall_health: UNKNOWN } } }
I20260812 06:16:14.818892 27649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.816471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46230 (local address 127.0.176.193:44499)
0812 06:16:14.816537 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:14.816539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:14.816546 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:16:14.816584 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:14.816585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:14.816604 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:14.816667 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:16:14.816851 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.817330 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.818108 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:14.818303 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:14.818385 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:14.818515 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:16:14.818643 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:16:14.818708 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:14.818749 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 06:16:14.818770 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:16:14.821089 27320 raft_consensus.cc:1261] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359 [term 1 FOLLOWER]: Refusing update from remote peer 48d0fbf07cfa494185380f79add38d48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:16:14.821118 27551 raft_consensus.cc:1261] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19 [term 1 FOLLOWER]: Refusing update from remote peer 48d0fbf07cfa494185380f79add38d48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:16:14.821501 27667 consensus_queue.cc:1035] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:16:14.821668 27669 consensus_queue.cc:1035] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:16:14.823213 27188 tablet.cc:2369] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:16:14.825255 27677 mvcc.cc:205] Tried to move back new op lower bound from 7317566975264276480 to 7317566975190695936. Current Snapshot: MvccSnapshot[applied={T|T < 7317566975264276480}]
I20260812 06:16:14.825407 27679 mvcc.cc:205] Tried to move back new op lower bound from 7317566975264276480 to 7317566975190695936. Current Snapshot: MvccSnapshot[applied={T|T < 7317566975264276480 or (T in {7317566975264276480})}]
I20260812 06:16:14.826797 26832 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:16:14.826912 26832 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:16:14.827764 26832 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Sending DeleteTablet for 3 replicas of tablet 416448e09e034c009f5e9028d2ca5601
I20260812 06:16:14.828166 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 26948
I20260812 06:16:14.828243 27289 tablet_service.cc:1514] Processing DeleteTablet for tablet 416448e09e034c009f5e9028d2ca5601 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:16:14 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:37240
I20260812 06:16:14.828253 27515 tablet_service.cc:1514] Processing DeleteTablet for tablet 416448e09e034c009f5e9028d2ca5601 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:16:14 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:33576
I20260812 06:16:14.840292 27698 tablet_replica.cc:330] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359: stopping tablet replica
I20260812 06:16:14.840489 27698 raft_consensus.cc:2229] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:16:14.840615 27698 raft_consensus.cc:2258] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:16:14.840792 27693 tablet_replica.cc:330] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19: stopping tablet replica
I20260812 06:16:14.840900 27693 raft_consensus.cc:2229] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:16:14.840986 27693 raft_consensus.cc:2258] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:16:14.847064 27698 ts_tablet_manager.cc:1905] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:16:14.847262 27693 ts_tablet_manager.cc:1905] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:16:14.848827 27693 ts_tablet_manager.cc:1918] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:16:14.848961 27693 log.cc:1196] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/416448e09e034c009f5e9028d2ca5601
I20260812 06:16:14.849268 27698 ts_tablet_manager.cc:1918] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:16:14.849292 27693 ts_tablet_manager.cc:1939] T 416448e09e034c009f5e9028d2ca5601 P 2f1880519c5a42c090b3d03a37a56b19: Deleting consensus metadata
I20260812 06:16:14.849361 27698 log.cc:1196] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/416448e09e034c009f5e9028d2ca5601
I20260812 06:16:14.849711 27698 ts_tablet_manager.cc:1939] T 416448e09e034c009f5e9028d2ca5601 P c34af7aaa1724906adf4b25703b6a359: Deleting consensus metadata
I20260812 06:16:14.849877 26807 catalog_manager.cc:4841] TS 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057): tablet 416448e09e034c009f5e9028d2ca5601 (table test-table [id=1abf0c7ceec4437596061685dcb4cace]) successfully deleted
I20260812 06:16:14.850323 26808 catalog_manager.cc:4841] TS c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023): tablet 416448e09e034c009f5e9028d2ca5601 (table test-table [id=1abf0c7ceec4437596061685dcb4cace]) successfully deleted
W20260812 06:16:14.852099 26808 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:44499 (error 108)
I20260812 06:16:14.852288 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 27195
I20260812 06:16:14.858754 27647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:14.858541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44499 (local address 127.0.0.1:46234)
0812 06:16:14.858624 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:14.858697 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:44499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 06:16:14.858929 26808 catalog_manager.cc:4584] TS 48d0fbf07cfa494185380f79add38d48 (127.0.176.193:44499): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 416448e09e034c009f5e9028d2ca5601: Network error: Client connection negotiation failed: client connection to 127.0.176.193:44499: connect: Connection refused (error 111)
I20260812 06:16:14.870190 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 27413
I20260812 06:16:14.901512 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 26784
I20260812 06:16:34.923213 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:36167
--webserver_interface=127.0.176.254
--webserver_port=39675
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:36167
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:16:35.013144 27701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:16:35.013386 27701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:16:35.013411 27701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:16:35.014554 27701 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 06:16:35.014596 27701 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 06:16:35.014611 27701 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 06:16:35.014622 27701 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:16:35.014635 27701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:16:35.014648 27701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:16:35.014662 27701 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:16:35.014672 27701 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:16:35.016218 27701 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:36167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:36167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=39675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:16:35.016446 27701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:16:35.016650 27701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:16:35.026628 27710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:35.026630 27712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:35.026611 27714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:35.027066 27701 server_base.cc:1034] running on GCE node
I20260812 06:16:35.027448 27701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:16:35.027827 27701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:16:35.029006 27701 hybrid_clock.cc:648] HybridClock initialized: now 1786515395028983 us; error 41 us; skew 500 ppm
Aug 12 06:16:35 dist-test-slave-gw5c krb5kdc[26766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515395, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:16:35.035463 27701 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:16:35.036036 27701 webserver.cc:460] Webserver started at http://127.0.176.254:39675/ using document root <none> and password file <none>
I20260812 06:16:35.036310 27701 fs_manager.cc:359] Metadata directory not provided
I20260812 06:16:35.036412 27701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:16:35.037909 27701 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:16:35.038617 27722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:35.038825 27701 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:16:35.038950 27701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "b0a3abd404a94a64b6946c92c4e2da37"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "079861779de2e6981b32b16d7fd98fa5"
server_key_iv: "44c20ec2a86dd4a7fd5910a16804a375"
server_key_version: "encryptionkey@0"
I20260812 06:16:35.039439 27701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:16:35.065083 27701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:16:35.067297 27701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:16:35.067504 27701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:16:35.072010 27701 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:36167
I20260812 06:16:35.072069 27816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:36167 every 8 connection(s)
I20260812 06:16:35.072474 27701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:16:35.074074 27817 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:16:35.074887 27817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Bootstrap starting.
I20260812 06:16:35.080804 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 27701
I20260812 06:16:35.081228 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:44499
--local_ip_for_outbound_sockets=127.0.176.193
--tserver_master_addrs=127.0.176.254:36167
--webserver_port=37373
--webserver_interface=127.0.176.193
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:16:35.084939 27817 log.cc:824] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Log is configured to *not* fsync() on all Append() calls
I20260812 06:16:35.088166 27817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:16:35.088559 27817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Bootstrap complete.
I20260812 06:16:35.092154 27817 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } }
I20260812 06:16:35.092499 27817 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0a3abd404a94a64b6946c92c4e2da37, State: Initialized, Role: FOLLOWER
I20260812 06:16:35.092730 27817 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } }
I20260812 06:16:35.092841 27817 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:16:35.092906 27817 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:16:35.092958 27817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:16:35.094127 27817 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } }
I20260812 06:16:35.094270 27817 leader_election.cc:302] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0a3abd404a94a64b6946c92c4e2da37; no voters:
I20260812 06:16:35.094484 27817 leader_election.cc:288] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 06:16:35.094573 27826 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:16:35.094800 27817 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:16:35.094805 27826 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 2 LEADER]: Becoming Leader. State: Replica: b0a3abd404a94a64b6946c92c4e2da37, State: Running, Role: LEADER
I20260812 06:16:35.094995 27826 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } }
I20260812 06:16:35.095311 27828 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b0a3abd404a94a64b6946c92c4e2da37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } } }
I20260812 06:16:35.095602 27828 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: This master's current role is: LEADER
I20260812 06:16:35.095533 27829 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0a3abd404a94a64b6946c92c4e2da37. Latest consensus state: current_term: 2 leader_uuid: "b0a3abd404a94a64b6946c92c4e2da37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } } }
I20260812 06:16:35.095911 27829 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: This master's current role is: LEADER
I20260812 06:16:35.097268 27851 catalog_manager.cc:1259] Loaded cluster ID: 334a9a538c2342469dcfac3c185a4524
I20260812 06:16:35.097385 27851 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: loading cluster ID for follower catalog manager: success
I20260812 06:16:35.098562 27851 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: acquiring CA information for follower catalog manager: success
I20260812 06:16:35.099020 27851 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:16:35.099098 27835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:16:35.099555 27835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:16:35.099651 27835 catalog_manager.cc:1259] Loaded cluster ID: 334a9a538c2342469dcfac3c185a4524
I20260812 06:16:35.099686 27835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:16:35.099874 27835 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:16:35.099972 27835 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Loaded TSK: 0
I20260812 06:16:35.115608 27835 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Generated new TSK 1
I20260812 06:16:35.115747 27835 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:16:35.173530 27823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:16:35.173813 27823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:16:35.173857 27823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:16:35.175079 27823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:16:35.175160 27823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:16:35.175209 27823 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:16:35.176862 27823 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:44499
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=37373
--tserver_master_addrs=127.0.176.254:36167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27823
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:16:35.177166 27823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:16:35.177438 27823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:16:35.183996 27861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:35.184052 27860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:35.184265 27823 server_base.cc:1034] running on GCE node
W20260812 06:16:35.184012 27863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:35.184656 27823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:16:35.184988 27823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:16:35.186195 27823 hybrid_clock.cc:648] HybridClock initialized: now 1786515395186183 us; error 31 us; skew 500 ppm
Aug 12 06:16:35 dist-test-slave-gw5c krb5kdc[26766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515395, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:16:35.191025 27823 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:16:35.191666 27823 webserver.cc:460] Webserver started at http://127.0.176.193:37373/ using document root <none> and password file <none>
I20260812 06:16:35.191947 27823 fs_manager.cc:359] Metadata directory not provided
I20260812 06:16:35.192052 27823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:16:35.193625 27823 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:16:35.194437 27875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:35.194814 27823 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:16:35.194994 27823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "48d0fbf07cfa494185380f79add38d48"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "96083e92abe433737b554a2c524c33b0"
server_key_iv: "8f48ceb058f4d496f8db1a658136ee1f"
server_key_version: "encryptionkey@0"
I20260812 06:16:35.195509 27823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:16:35.211520 27823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:16:35.214066 27823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:16:35.214253 27823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:16:35.214531 27823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:16:35.215036 27887 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 06:16:35.217046 27823 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:16:35.217131 27823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 06:16:35.217182 27823 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 06:16:35.217904 27823 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 06:16:35.217967 27823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 06:16:35.218039 27887 tablet_bootstrap.cc:492] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Bootstrap starting.
I20260812 06:16:35.226854 27823 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:44499
I20260812 06:16:35.226907 28059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:44499 every 8 connection(s)
I20260812 06:16:35.227596 27823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:16:35.230029 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 27823
I20260812 06:16:35.230386 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:41023
--local_ip_for_outbound_sockets=127.0.176.194
--tserver_master_addrs=127.0.176.254:36167
--webserver_port=42139
--webserver_interface=127.0.176.194
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:16:35.230818 27887 log.cc:824] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Log is configured to *not* fsync() on all Append() calls
I20260812 06:16:35.233458 27887 tablet_bootstrap.cc:492] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:16:35.233800 27887 tablet_bootstrap.cc:492] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Bootstrap complete.
I20260812 06:16:35.234979 27887 ts_tablet_manager.cc:1397] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.009s
I20260812 06:16:35.236577 27887 raft_consensus.cc:348] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } } peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } }
I20260812 06:16:35.237030 27887 raft_consensus.cc:729] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d0fbf07cfa494185380f79add38d48, State: Initialized, Role: FOLLOWER
I20260812 06:16:35.237257 27887 consensus_queue.cc:260] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } } peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } }
I20260812 06:16:35.237658 27887 ts_tablet_manager.cc:1428] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
Aug 12 06:16:35 dist-test-slave-gw5c krb5kdc[26766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515395, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:16:35.245342 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.228600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:46361 (local address 127.0.176.254:36167)
0812 06:16:35.228809 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:35.228819 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:35.234041 (+ 5222us) server_negotiation.cc:407] Connection header received
0812 06:16:35.234779 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:35.234787 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:35.234846 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:35.235003 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:16:35.236050 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.237410 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.238594 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.239020 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.239169 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.241555 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:16:35.241560 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:16:35.241560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:16:35.241580 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:16:35.243515 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:35.243967 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:35.243971 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:35.243971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:35.244069 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:35.244355 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:35.244356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:35.244356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:35.244598 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:16:35.244700 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:35.245008 (+ 308us) server_negotiation.cc:299] Negotiation successful
0812 06:16:35.245139 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":91,"threads_started":1}
I20260812 06:16:35.245342 28064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.228531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:46361)
0812 06:16:35.233816 (+ 5285us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:35.233866 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:35.234541 (+ 675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:35.235162 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:35.235167 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:35.235572 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:16:35.235884 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.235891 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.237569 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.237570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.238475 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.238479 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.239148 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.239149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.239290 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.239946 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:16:35.239956 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:16:35.241411 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:16:35.243602 (+ 2191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:35.243610 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:35.243613 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:35.243861 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:35.244150 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:35.244151 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:35.244152 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:35.244277 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:35.244677 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:16:35.244686 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:16:35.244831 (+ 145us) client_negotiation.cc:769] Sending connection context
0812 06:16:35.244937 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 06:16:35.245131 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5233,"thread_start_us":122,"threads_started":1}
I20260812 06:16:35.246097 28060 heartbeater.cc:347] Connected to a master server at 127.0.176.254:36167
I20260812 06:16:35.246234 28060 heartbeater.cc:464] Registering TS with master...
I20260812 06:16:35.246791 28060 heartbeater.cc:511] Master 127.0.176.254:36167 requested a full tablet report, sending...
I20260812 06:16:35.247686 27754 ts_manager.cc:194] Registered new tserver with Master: 48d0fbf07cfa494185380f79add38d48 (127.0.176.193:44499)
I20260812 06:16:35.248909 27754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:46361
I20260812 06:16:35.249818 28060 heartbeater.cc:503] Master 127.0.176.254:36167 was elected leader, sending a full tablet report...
I20260812 06:16:35.255553 28073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.248358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44499 (local address 127.0.0.1:44186)
0812 06:16:35.251571 (+ 3213us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:35.251629 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:35.251703 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:35.251945 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:35.251948 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:35.251950 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:16:35.252010 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.252011 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.253314 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.253315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.254152 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.254155 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.255164 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.255165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.255262 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.255274 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 06:16:35.255359 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 06:16:35.255481 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3168,"thread_start_us":106,"threads_started":1}
I20260812 06:16:35.255551 28074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.248629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44186 (local address 127.0.176.193:44499)
0812 06:16:35.251617 (+ 2988us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:35.251623 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:35.251691 (+ 68us) server_negotiation.cc:407] Connection header received
0812 06:16:35.251812 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:35.251814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:35.251832 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:35.251937 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:16:35.252059 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.253199 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.254256 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.255047 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.255129 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.255191 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:35.255418 (+ 227us) server_negotiation.cc:299] Negotiation successful
0812 06:16:35.255462 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2947,"thread_start_us":87,"threads_started":1}
I20260812 06:16:35.256184 27925 tablet_service.cc:1514] Processing DeleteTablet for tablet 416448e09e034c009f5e9028d2ca5601 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:16:14 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:44186
I20260812 06:16:35.256850 28075 tablet_replica.cc:330] stopping tablet replica
I20260812 06:16:35.256984 28075 raft_consensus.cc:2229] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:16:35.257078 28075 raft_consensus.cc:2258] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:16:35.257431 28075 ts_tablet_manager.cc:1905] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:16:35.259348 28075 ts_tablet_manager.cc:1918] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:16:35.259461 28075 log.cc:1196] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal/wals/416448e09e034c009f5e9028d2ca5601
I20260812 06:16:35.259691 28075 ts_tablet_manager.cc:1939] T 416448e09e034c009f5e9028d2ca5601 P 48d0fbf07cfa494185380f79add38d48: Deleting consensus metadata
I20260812 06:16:35.260223 27728 catalog_manager.cc:4841] TS 48d0fbf07cfa494185380f79add38d48 (127.0.176.193:44499): tablet 416448e09e034c009f5e9028d2ca5601 (table test-table [id=1abf0c7ceec4437596061685dcb4cace]) successfully deleted
W20260812 06:16:35.326471 28071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:16:35.326715 28071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:16:35.326742 28071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:16:35.328467 28071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:16:35.328531 28071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:16:35.328563 28071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:16:35.330265 28071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:41023
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=42139
--tserver_master_addrs=127.0.176.254:36167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:16:35.330557 28071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:16:35.330827 28071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:16:35.336064 28091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:35.336036 28087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:35.336081 28085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:35.336333 28071 server_base.cc:1034] running on GCE node
I20260812 06:16:35.336560 28071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:16:35.336848 28071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:16:35.338028 28071 hybrid_clock.cc:648] HybridClock initialized: now 1786515395338018 us; error 42 us; skew 500 ppm
Aug 12 06:16:35 dist-test-slave-gw5c krb5kdc[26766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515395, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:16:35.341063 28071 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:16:35.341583 28071 webserver.cc:460] Webserver started at http://127.0.176.194:42139/ using document root <none> and password file <none>
I20260812 06:16:35.341850 28071 fs_manager.cc:359] Metadata directory not provided
I20260812 06:16:35.341948 28071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:16:35.343551 28071 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:16:35.344238 28105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:35.344436 28071 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:16:35.344528 28071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "c34af7aaa1724906adf4b25703b6a359"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "0a0b8560529b7da06b0c7437f113c52e"
server_key_iv: "62a59e5307c1de491e8c11edbbb854c5"
server_key_version: "encryptionkey@0"
I20260812 06:16:35.344890 28071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:16:35.355666 28071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:16:35.357774 28071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:16:35.357963 28071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:16:35.358217 28071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:16:35.358533 28071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:16:35.358589 28071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:35.358634 28071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:16:35.358665 28071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:35.365016 28071 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:41023
I20260812 06:16:35.365069 28286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:41023 every 8 connection(s)
I20260812 06:16:35.365418 28071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:16:35.369113 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 28071
I20260812 06:16:35.369433 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:39057
--local_ip_for_outbound_sockets=127.0.176.195
--tserver_master_addrs=127.0.176.254:36167
--webserver_port=44209
--webserver_interface=127.0.176.195
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:16:35 dist-test-slave-gw5c krb5kdc[26766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515395, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:16:35.378135 28290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.366166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:48817)
0812 06:16:35.366328 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:35.366372 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:35.366866 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:35.367072 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:35.367076 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:35.367689 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:16:35.368151 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.368159 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.368993 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.368994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.370014 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.370017 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.370768 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.370769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.371043 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.371741 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:16:35.371751 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:16:35.373997 (+ 2246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:16:35.376158 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:35.376167 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:35.376170 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:35.376523 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:35.376761 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:35.376762 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:35.376763 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:35.376930 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:35.377284 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:16:35.377293 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:16:35.377493 (+ 200us) client_negotiation.cc:769] Sending connection context
0812 06:16:35.377619 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 06:16:35.377824 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
I20260812 06:16:35.378572 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.366206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:48817 (local address 127.0.176.254:36167)
0812 06:16:35.366256 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:35.366258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:35.366466 (+ 208us) server_negotiation.cc:407] Connection header received
0812 06:16:35.366949 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:35.366950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:35.366962 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:35.367023 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:16:35.368316 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.368842 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.370115 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.370634 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.370727 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.374120 (+ 3393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:16:35.374144 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:16:35.374144 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:16:35.374151 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:16:35.376053 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:35.376615 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:35.376616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:35.376617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:35.376683 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:35.377010 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:35.377011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:35.377011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:35.377175 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:16:35.377253 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:35.378322 (+ 1069us) server_negotiation.cc:299] Negotiation successful
0812 06:16:35.378436 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:16:35.379473 28287 heartbeater.cc:347] Connected to a master server at 127.0.176.254:36167
I20260812 06:16:35.379581 28287 heartbeater.cc:464] Registering TS with master...
I20260812 06:16:35.379802 28287 heartbeater.cc:511] Master 127.0.176.254:36167 requested a full tablet report, sending...
I20260812 06:16:35.380244 27754 ts_manager.cc:194] Registered new tserver with Master: c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023)
I20260812 06:16:35.380648 27754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:48817
W20260812 06:16:35.461263 28291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:16:35.461503 28291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:16:35.461531 28291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:16:35.462673 28291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:16:35.462718 28291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:16:35.462746 28291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:16:35.464211 28291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:39057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=44209
--tserver_master_addrs=127.0.176.254:36167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:16:35.464422 28291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:16:35.464612 28291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:16:35.469825 28297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:35.469810 28296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:35.469945 28291 server_base.cc:1034] running on GCE node
W20260812 06:16:35.469810 28302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:35.470193 28291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:16:35.470788 28291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:16:35.471978 28291 hybrid_clock.cc:648] HybridClock initialized: now 1786515395471952 us; error 52 us; skew 500 ppm
Aug 12 06:16:35 dist-test-slave-gw5c krb5kdc[26766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515395, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:16:35.474562 28291 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:16:35.475075 28291 webserver.cc:460] Webserver started at http://127.0.176.195:44209/ using document root <none> and password file <none>
I20260812 06:16:35.475315 28291 fs_manager.cc:359] Metadata directory not provided
I20260812 06:16:35.475428 28291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:16:35.476821 28291 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:16:35.477484 28309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:35.477705 28291 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:16:35.477814 28291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "2f1880519c5a42c090b3d03a37a56b19"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "f62202627e83b2c5577dadc45d078226"
server_key_iv: "a7f61405cad9cb98c78e1eb4123d9639"
server_key_version: "encryptionkey@0"
I20260812 06:16:35.478191 28291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:16:35.490653 28291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:16:35.493332 28291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:16:35.493525 28291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:16:35.493789 28291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:16:35.494134 28291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:16:35.494199 28291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:35.494243 28291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:16:35.494277 28291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:35.501103 28291 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:39057
I20260812 06:16:35.501147 28485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:39057 every 8 connection(s)
I20260812 06:16:35.501562 28291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:16:35 dist-test-slave-gw5c krb5kdc[26766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515395, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:16:35.509608 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 28291
I20260812 06:16:35.511914 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.502377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:39905 (local address 127.0.176.254:36167)
0812 06:16:35.502429 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:35.502431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:35.502631 (+ 200us) server_negotiation.cc:407] Connection header received
0812 06:16:35.503185 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:35.503186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:35.503200 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:35.503252 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:16:35.504329 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.504833 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.505908 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.506134 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.506225 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.508629 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:16:35.508631 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:16:35.508631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:16:35.508639 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:16:35.510278 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:35.510793 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:35.510794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:35.510795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:35.510864 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:35.511115 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:35.511116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:35.511117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:35.511279 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:16:35.511351 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:35.511754 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 06:16:35.511832 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:16:35.512146 28491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.502329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:39905)
0812 06:16:35.502504 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:35.502542 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:35.503068 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:35.503321 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:35.503326 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:35.504005 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:16:35.504214 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.504219 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.504936 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.504937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.505817 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.505820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.506239 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.506240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.506371 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.506981 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:16:35.506990 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:16:35.508520 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:16:35.510389 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:35.510397 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:35.510400 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:35.510714 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:35.510940 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:35.510941 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:35.510941 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:35.511046 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:35.511369 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:16:35.511377 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:16:35.511570 (+ 193us) client_negotiation.cc:769] Sending connection context
0812 06:16:35.511713 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 06:16:35.511890 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260812 06:16:35.512806 28489 heartbeater.cc:347] Connected to a master server at 127.0.176.254:36167
I20260812 06:16:35.512950 28489 heartbeater.cc:464] Registering TS with master...
I20260812 06:16:35.513181 28489 heartbeater.cc:511] Master 127.0.176.254:36167 requested a full tablet report, sending...
I20260812 06:16:35.513633 27754 ts_manager.cc:194] Registered new tserver with Master: 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057)
I20260812 06:16:35.514009 27754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:39905
I20260812 06:16:35.517405 28494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.510124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40154 (local address 127.0.176.254:36167)
0812 06:16:35.510267 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:35.510269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:35.510378 (+ 109us) server_negotiation.cc:407] Connection header received
0812 06:16:35.510446 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:35.510447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:35.510462 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:35.510534 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:16:35.511364 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.512141 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.513313 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.513582 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.513664 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.514961 (+ 1297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:16:35.514962 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:16:35.514962 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:16:35.514968 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:16:35.516354 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:35.516720 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:35.516721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:35.516721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:35.516782 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:35.516954 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:35.516954 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:35.516955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:35.517046 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:16:35.517184 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:35.517212 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 06:16:35.517280 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":63,"threads_started":1}
I20260812 06:16:35.518276 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:16:35.520804 28494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.518629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40158 (local address 127.0.176.254:36167)
0812 06:16:35.518664 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:35.518666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:35.518803 (+ 137us) server_negotiation.cc:407] Connection header received
0812 06:16:35.518859 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:35.518860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:35.518885 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:35.518946 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:16:35.519052 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.519586 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.520259 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.520444 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.520494 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.520615 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:16:35.520655 (+ 40us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 06:16:35.520761 (+ 106us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40158: token expired
Metrics: {"server-negotiator.queue_time_us":15}
W20260812 06:16:35.520891 28494 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40158: token expired
W20260812 06:16:35.521076 27637 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.176.254:36167)
I20260812 06:16:35.527082 28494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.521369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40172 (local address 127.0.176.254:36167)
0812 06:16:35.521402 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:35.521403 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:35.521412 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:16:35.521434 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:35.521435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:35.521443 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:35.521501 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:16:35.521945 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.522364 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.523002 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.523165 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.523212 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.524648 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:16:35.524650 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:16:35.524650 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:16:35.524656 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:16:35.526087 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:35.526433 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:35.526434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:35.526434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:35.526489 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:35.526656 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:35.526657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:35.526657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:35.526789 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:16:35.526868 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:35.526961 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 06:16:35.527021 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:16:35.528390 27754 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40172:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:16:35.530282 27754 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:16:35.532892 27925 tablet_service.cc:1467] Processing CreateTablet for tablet 7b6d10e1c49e4f749d66664cb992376c (DEFAULT_TABLE table=test-table [id=e870771ce13448bc9c358bafe54b40c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:16:35.533115 27925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b6d10e1c49e4f749d66664cb992376c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:16:35.534499 27887 tablet_bootstrap.cc:492] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48: Bootstrap starting.
I20260812 06:16:35.534853 27887 tablet_bootstrap.cc:654] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48: Neither blocks nor log segments found. Creating new log.
I20260812 06:16:35.535621 27887 tablet_bootstrap.cc:492] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48: No bootstrap required, opened a new log
I20260812 06:16:35.535669 27887 ts_tablet_manager.cc:1397] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:16:35.535786 27887 raft_consensus.cc:348] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:16:35.535852 27887 raft_consensus.cc:374] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:16:35.535894 27887 raft_consensus.cc:729] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d0fbf07cfa494185380f79add38d48, State: Initialized, Role: FOLLOWER
I20260812 06:16:35.535938 27887 consensus_queue.cc:260] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:16:35.536015 27887 ts_tablet_manager.cc:1428] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:35.537010 28073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.532423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:41023 (local address 127.0.0.1:52188)
0812 06:16:35.532547 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:35.532559 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:35.532594 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:35.532886 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:35.532888 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:35.532889 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:16:35.532944 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.532946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.534634 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.534635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.535738 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.535741 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.536739 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.536740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.536800 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.536803 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:16:35.536846 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:16:35.536920 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":45}
I20260812 06:16:35.537030 28499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.532523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52188 (local address 127.0.176.194:41023)
0812 06:16:35.532694 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:35.532700 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:35.532713 (+ 13us) server_negotiation.cc:407] Connection header received
0812 06:16:35.532759 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:35.532761 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:35.532780 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:35.533027 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:16:35.533122 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.534507 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.535836 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.536614 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.536723 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.536787 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:35.536876 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 06:16:35.536931 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":98,"threads_started":1}
I20260812 06:16:35.537147 28498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.532441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:39057 (local address 127.0.0.1:43772)
0812 06:16:35.532714 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:35.532725 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:35.532778 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:35.533157 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:35.533158 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:35.533160 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:16:35.533212 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.533214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.534634 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.534635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.536017 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.536020 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.536911 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.536912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.536964 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.536967 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:16:35.537027 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:16:35.537069 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":207,"thread_start_us":133,"threads_started":1}
I20260812 06:16:35.537173 28501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.532768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43772 (local address 127.0.176.195:39057)
0812 06:16:35.532961 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:35.532966 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:35.532975 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:16:35.533018 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:35.533020 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:35.533035 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:35.533148 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:16:35.533384 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.534517 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.536117 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.536827 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.536902 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.536953 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:35.537041 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 06:16:35.537087 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":99,"threads_started":1}
I20260812 06:16:35.538038 28393 tablet_service.cc:1467] Processing CreateTablet for tablet 7b6d10e1c49e4f749d66664cb992376c (DEFAULT_TABLE table=test-table [id=e870771ce13448bc9c358bafe54b40c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:16:35.538269 28172 tablet_service.cc:1467] Processing CreateTablet for tablet 7b6d10e1c49e4f749d66664cb992376c (DEFAULT_TABLE table=test-table [id=e870771ce13448bc9c358bafe54b40c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:16:35.538422 28393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b6d10e1c49e4f749d66664cb992376c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:16:35.538796 28172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b6d10e1c49e4f749d66664cb992376c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:16:35.541486 28505 tablet_bootstrap.cc:492] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19: Bootstrap starting.
I20260812 06:16:35.541774 28506 tablet_bootstrap.cc:492] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359: Bootstrap starting.
I20260812 06:16:35.542296 28505 tablet_bootstrap.cc:654] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19: Neither blocks nor log segments found. Creating new log.
I20260812 06:16:35.542492 28506 tablet_bootstrap.cc:654] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359: Neither blocks nor log segments found. Creating new log.
I20260812 06:16:35.542876 28505 log.cc:824] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19: Log is configured to *not* fsync() on all Append() calls
I20260812 06:16:35.543118 28506 log.cc:824] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359: Log is configured to *not* fsync() on all Append() calls
I20260812 06:16:35.543789 28505 tablet_bootstrap.cc:492] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19: No bootstrap required, opened a new log
I20260812 06:16:35.543886 28505 ts_tablet_manager.cc:1397] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:16:35.543944 28506 tablet_bootstrap.cc:492] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359: No bootstrap required, opened a new log
I20260812 06:16:35.544013 28506 ts_tablet_manager.cc:1397] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:16:35.545571 28505 raft_consensus.cc:348] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:16:35.545598 28506 raft_consensus.cc:348] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:16:35.545745 28505 raft_consensus.cc:374] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:16:35.545742 28506 raft_consensus.cc:374] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:16:35.545794 28505 raft_consensus.cc:729] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f1880519c5a42c090b3d03a37a56b19, State: Initialized, Role: FOLLOWER
I20260812 06:16:35.545802 28506 raft_consensus.cc:729] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c34af7aaa1724906adf4b25703b6a359, State: Initialized, Role: FOLLOWER
I20260812 06:16:35.545925 28506 consensus_queue.cc:260] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:16:35.545928 28505 consensus_queue.cc:260] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:16:35.546237 28287 heartbeater.cc:503] Master 127.0.176.254:36167 was elected leader, sending a full tablet report...
I20260812 06:16:35.546249 28505 ts_tablet_manager.cc:1428] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:16:35.546258 28489 heartbeater.cc:503] Master 127.0.176.254:36167 was elected leader, sending a full tablet report...
I20260812 06:16:35.546236 28506 ts_tablet_manager.cc:1428] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260812 06:16:35.616120 28288 tablet.cc:2369] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:16:35.617503 28519 raft_consensus.cc:482] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:16:35.617616 28519 raft_consensus.cc:504] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:16:35.617951 28519 leader_election.cc:288] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057), 48d0fbf07cfa494185380f79add38d48 (127.0.176.193:44499)
I20260812 06:16:35.621846 28501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.618377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:50911 (local address 127.0.176.195:39057)
0812 06:16:35.618439 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:35.618441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:35.618626 (+ 185us) server_negotiation.cc:407] Connection header received
0812 06:16:35.618659 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:35.618660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:35.618671 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:35.618733 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:16:35.618956 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.619539 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.620618 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.621257 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.621350 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.621363 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:35.621664 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 06:16:35.621742 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:16:35.622130 28074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.618411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:55009 (local address 127.0.176.193:44499)
0812 06:16:35.618462 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:35.618464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:35.618474 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:16:35.618508 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:35.618509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:35.618521 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:35.618584 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:16:35.618800 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.619341 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.620494 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.621736 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.621805 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.621813 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:35.622014 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 06:16:35.622062 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:16:35.622139 28290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.618223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44499 (local address 127.0.176.194:55009)
0812 06:16:35.618327 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:35.618342 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:35.618411 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:35.618630 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:35.618631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:35.618634 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:16:35.618719 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.618721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.619453 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.619454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.620395 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.620398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.621826 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.621827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.621903 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.621907 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:16:35.621994 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 06:16:35.622044 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":3}
I20260812 06:16:35.622150 28521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.618223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:39057 (local address 127.0.176.194:50911)
0812 06:16:35.618447 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:35.618459 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:35.618533 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:35.618744 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:35.618745 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:35.618746 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:16:35.618843 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.618844 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.619746 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.619747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.620500 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:35.620502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.621369 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.621371 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:35.621529 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.621537 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 06:16:35.621951 (+ 414us) client_negotiation.cc:240] Negotiation successful
0812 06:16:35.622028 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":21,"thread_start_us":95,"threads_started":1}
I20260812 06:16:35.622498 27990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b6d10e1c49e4f749d66664cb992376c" candidate_uuid: "c34af7aaa1724906adf4b25703b6a359" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d0fbf07cfa494185380f79add38d48" is_pre_election: true
I20260812 06:16:35.622642 27990 raft_consensus.cc:2454] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c34af7aaa1724906adf4b25703b6a359 in term 0.
I20260812 06:16:35.622944 28109 leader_election.cc:302] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d0fbf07cfa494185380f79add38d48, c34af7aaa1724906adf4b25703b6a359; no voters:
I20260812 06:16:35.623026 28422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b6d10e1c49e4f749d66664cb992376c" candidate_uuid: "c34af7aaa1724906adf4b25703b6a359" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f1880519c5a42c090b3d03a37a56b19" is_pre_election: true
I20260812 06:16:35.623127 28519 raft_consensus.cc:2781] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:16:35.623178 28422 raft_consensus.cc:2454] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c34af7aaa1724906adf4b25703b6a359 in term 0.
I20260812 06:16:35.623366 28519 raft_consensus.cc:482] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:16:35.623448 28519 raft_consensus.cc:3037] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:16:35.624217 28519 raft_consensus.cc:504] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:16:35.624372 28519 leader_election.cc:288] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [CANDIDATE]: Term 1 election: Requested vote from peers 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057), 48d0fbf07cfa494185380f79add38d48 (127.0.176.193:44499)
I20260812 06:16:35.624583 28422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b6d10e1c49e4f749d66664cb992376c" candidate_uuid: "c34af7aaa1724906adf4b25703b6a359" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f1880519c5a42c090b3d03a37a56b19"
I20260812 06:16:35.624565 27990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b6d10e1c49e4f749d66664cb992376c" candidate_uuid: "c34af7aaa1724906adf4b25703b6a359" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d0fbf07cfa494185380f79add38d48"
I20260812 06:16:35.624656 27990 raft_consensus.cc:3037] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:16:35.624656 28422 raft_consensus.cc:3037] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:16:35.625550 27990 raft_consensus.cc:2454] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34af7aaa1724906adf4b25703b6a359 in term 1.
I20260812 06:16:35.625550 28422 raft_consensus.cc:2454] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c34af7aaa1724906adf4b25703b6a359 in term 1.
I20260812 06:16:35.625746 28107 leader_election.cc:302] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1880519c5a42c090b3d03a37a56b19, c34af7aaa1724906adf4b25703b6a359; no voters:
I20260812 06:16:35.625828 28519 raft_consensus.cc:2781] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:16:35.625990 28519 raft_consensus.cc:686] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [term 1 LEADER]: Becoming Leader. State: Replica: c34af7aaa1724906adf4b25703b6a359, State: Running, Role: LEADER
I20260812 06:16:35.626118 28519 consensus_queue.cc:237] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:16:35.627008 27754 catalog_manager.cc:5495] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 reported cstate change: term changed from 0 to 1, leader changed from <none> to c34af7aaa1724906adf4b25703b6a359 (127.0.176.194). New cstate: current_term: 1 leader_uuid: "c34af7aaa1724906adf4b25703b6a359" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } health_report { overall_health: UNKNOWN } } }
I20260812 06:16:35.635380 28499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.632810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52198 (local address 127.0.176.194:41023)
0812 06:16:35.632888 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:35.632889 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:35.632898 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:16:35.632933 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:35.632934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:35.632951 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:35.633014 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:16:35.633165 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.633632 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.634412 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:35.634594 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:35.634646 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:35.634995 (+ 349us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:16:35.635101 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:16:35.635180 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:35.635275 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 06:16:35.635294 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 06:16:35.637343 28422 raft_consensus.cc:1261] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19 [term 1 FOLLOWER]: Refusing update from remote peer c34af7aaa1724906adf4b25703b6a359: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:16:35.637357 27990 raft_consensus.cc:1261] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Refusing update from remote peer c34af7aaa1724906adf4b25703b6a359: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:16:35.637764 28519 consensus_queue.cc:1035] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:16:35.637929 28523 consensus_queue.cc:1035] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:16:35.640388 28526 mvcc.cc:205] Tried to move back new op lower bound from 7317567060527529984 to 7317567060485230592. Current Snapshot: MvccSnapshot[applied={T|T < 7317567060527529984}]
I20260812 06:16:35.640588 28528 mvcc.cc:205] Tried to move back new op lower bound from 7317567060527529984 to 7317567060485230592. Current Snapshot: MvccSnapshot[applied={T|T < 7317567060527529984}]
I20260812 06:16:35.642915 27753 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:16:35.643038 27753 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:16:35.643929 27753 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Sending DeleteTablet for 3 replicas of tablet 7b6d10e1c49e4f749d66664cb992376c
I20260812 06:16:35.644275 28172 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b6d10e1c49e4f749d66664cb992376c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:16:35 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:52188
I20260812 06:16:35.644301 27925 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b6d10e1c49e4f749d66664cb992376c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:16:35 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:44186
I20260812 06:16:35.644356 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 27823
I20260812 06:16:35.644418 28075 tablet_replica.cc:330] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48: stopping tablet replica
I20260812 06:16:35.644384 28393 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b6d10e1c49e4f749d66664cb992376c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:16:35 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:43772
I20260812 06:16:35.644469 28075 raft_consensus.cc:2229] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:16:35.644541 28075 raft_consensus.cc:2258] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:16:35.644629 28543 tablet_replica.cc:330] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19: stopping tablet replica
I20260812 06:16:35.644724 28543 raft_consensus.cc:2229] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:16:35.647218 28542 tablet_replica.cc:330] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359: stopping tablet replica
I20260812 06:16:35.647361 28542 raft_consensus.cc:2229] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:16:35.647558 28543 raft_consensus.cc:2258] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:16:35.647753 28542 raft_consensus.cc:2258] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:16:35.652742 28542 ts_tablet_manager.cc:1905] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:16:35.655133 28542 ts_tablet_manager.cc:1918] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:16:35.655229 28542 log.cc:1196] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/7b6d10e1c49e4f749d66664cb992376c
I20260812 06:16:35.655550 28542 ts_tablet_manager.cc:1939] T 7b6d10e1c49e4f749d66664cb992376c P c34af7aaa1724906adf4b25703b6a359: Deleting consensus metadata
I20260812 06:16:35.657539 27728 catalog_manager.cc:4841] TS c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023): tablet 7b6d10e1c49e4f749d66664cb992376c (table test-table [id=e870771ce13448bc9c358bafe54b40c2]) successfully deleted
I20260812 06:16:35.658304 28543 ts_tablet_manager.cc:1905] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:16:35.661360 28543 ts_tablet_manager.cc:1918] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:16:35.661482 28543 log.cc:1196] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/7b6d10e1c49e4f749d66664cb992376c
I20260812 06:16:35.661906 28543 ts_tablet_manager.cc:1939] T 7b6d10e1c49e4f749d66664cb992376c P 2f1880519c5a42c090b3d03a37a56b19: Deleting consensus metadata
I20260812 06:16:35.662572 27726 catalog_manager.cc:4841] TS 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057): tablet 7b6d10e1c49e4f749d66664cb992376c (table test-table [id=e870771ce13448bc9c358bafe54b40c2]) successfully deleted
W20260812 06:16:35.670181 27728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:44499 (error 108)
I20260812 06:16:35.670433 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 28071
I20260812 06:16:35.689723 28498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:35.689534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44499 (local address 127.0.0.1:44194)
0812 06:16:35.689601 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:35.689667 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:44499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 06:16:35.689941 27728 catalog_manager.cc:4584] TS 48d0fbf07cfa494185380f79add38d48 (127.0.176.193:44499): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7b6d10e1c49e4f749d66664cb992376c: Network error: Client connection negotiation failed: client connection to 127.0.176.193:44499: connect: Connection refused (error 111)
I20260812 06:16:35.695797 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 28291
I20260812 06:16:35.709414 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 27701
I20260812 06:16:55.721982 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:36167
--webserver_interface=127.0.176.254
--webserver_port=39675
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:36167
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:16:55.819779 28545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:16:55.820070 28545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:16:55.820114 28545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:16:55.821424 28545 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 06:16:55.821502 28545 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 06:16:55.821524 28545 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 06:16:55.821547 28545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:16:55.821576 28545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:16:55.821610 28545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:16:55.821635 28545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:16:55.821663 28545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:16:55.823351 28545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:36167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:36167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=39675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:16:55.823787 28545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:16:55.824060 28545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:16:55.829865 28556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:55.829859 28557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:55.829857 28559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:55.829957 28545 server_base.cc:1034] running on GCE node
I20260812 06:16:55.830308 28545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:16:55.830646 28545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:16:55.831799 28545 hybrid_clock.cc:648] HybridClock initialized: now 1786515415831777 us; error 41 us; skew 500 ppm
Aug 12 06:16:55 dist-test-slave-gw5c krb5kdc[26766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515415, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:16:55.834823 28545 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:16:55.835318 28545 webserver.cc:460] Webserver started at http://127.0.176.254:39675/ using document root <none> and password file <none>
I20260812 06:16:55.835595 28545 fs_manager.cc:359] Metadata directory not provided
I20260812 06:16:55.835672 28545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:16:55.837132 28545 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:16:55.837872 28571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:55.838081 28545 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:16:55.838194 28545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "b0a3abd404a94a64b6946c92c4e2da37"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "079861779de2e6981b32b16d7fd98fa5"
server_key_iv: "44c20ec2a86dd4a7fd5910a16804a375"
server_key_version: "encryptionkey@0"
I20260812 06:16:55.838591 28545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:16:55.852538 28545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:16:55.855357 28545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:16:55.855643 28545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:16:55.860898 28545 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:36167
I20260812 06:16:55.860944 28649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:36167 every 8 connection(s)
I20260812 06:16:55.861485 28545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:16:55.863243 28650 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:16:55.864123 28650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Bootstrap starting.
I20260812 06:16:55.869886 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 28545
I20260812 06:16:55.870290 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:44499
--local_ip_for_outbound_sockets=127.0.176.193
--tserver_master_addrs=127.0.176.254:36167
--webserver_port=37373
--webserver_interface=127.0.176.193
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:16:55.875849 28650 log.cc:824] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Log is configured to *not* fsync() on all Append() calls
I20260812 06:16:55.878808 28650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:16:55.879544 28650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Bootstrap complete.
I20260812 06:16:55.882344 28650 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } }
I20260812 06:16:55.882635 28650 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0a3abd404a94a64b6946c92c4e2da37, State: Initialized, Role: FOLLOWER
I20260812 06:16:55.882848 28650 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } }
I20260812 06:16:55.882936 28650 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:16:55.883010 28650 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:16:55.883061 28650 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:16:55.884294 28650 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } }
I20260812 06:16:55.884433 28650 leader_election.cc:302] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0a3abd404a94a64b6946c92c4e2da37; no voters:
I20260812 06:16:55.884666 28650 leader_election.cc:288] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 06:16:55.884712 28655 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:16:55.884888 28655 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [term 3 LEADER]: Becoming Leader. State: Replica: b0a3abd404a94a64b6946c92c4e2da37, State: Running, Role: LEADER
I20260812 06:16:55.884996 28650 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:16:55.885052 28655 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } }
I20260812 06:16:55.885411 28655 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0a3abd404a94a64b6946c92c4e2da37. Latest consensus state: current_term: 3 leader_uuid: "b0a3abd404a94a64b6946c92c4e2da37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } } }
I20260812 06:16:55.885428 28659 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b0a3abd404a94a64b6946c92c4e2da37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a3abd404a94a64b6946c92c4e2da37" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 36167 } } }
I20260812 06:16:55.885614 28655 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: This master's current role is: LEADER
I20260812 06:16:55.885628 28659 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37 [sys.catalog]: This master's current role is: LEADER
I20260812 06:16:55.885881 28672 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:16:55.886976 28672 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:16:55.887156 28672 catalog_manager.cc:1259] Loaded cluster ID: 334a9a538c2342469dcfac3c185a4524
I20260812 06:16:55.887434 28672 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:16:55.888267 28672 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:16:55.888388 28672 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Loaded TSK: 0
I20260812 06:16:55.888412 28672 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b0a3abd404a94a64b6946c92c4e2da37: Loaded TSK: 1
F20260812 06:16:55.888562 28672 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f0e87e329ad google::LogMessage::Fail() at ??:0
@ 0x7f0e87e3588a google::LogMessage::SendToLog() at ??:0
@ 0x7f0e87e324de google::LogMessage::Flush() at ??:0
@ 0x7f0e87e33a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f0e8a59f104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f0e8a59cd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f0e8fd8c1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f0e8fd8c48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f0e8fd8c594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f0e8fd52c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f0e8fd5cad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f0e89d000d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f0e89cf5954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f0e8ab596db start_thread at ??:0
@ 0x7f0e8693061f clone at ??:0
W20260812 06:16:56.007457 28652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:16:56.007788 28652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:16:56.007830 28652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:16:56.009789 28652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:16:56.009871 28652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:16:56.009922 28652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:16:56.013792 28652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:44499
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=37373
--tserver_master_addrs=127.0.176.254:36167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:16:56.014165 28652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:16:56.014474 28652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:16:56.020691 28652 server_base.cc:1034] running on GCE node
W20260812 06:16:56.020834 28723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:56.020730 28727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:56.020973 28720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:56.021306 28652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:16:56.021651 28652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:16:56.022855 28652 hybrid_clock.cc:648] HybridClock initialized: now 1786515416022833 us; error 46 us; skew 500 ppm
Aug 12 06:16:56 dist-test-slave-gw5c krb5kdc[26766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515416, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:16:56.026511 28652 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:16:56.027056 28652 webserver.cc:460] Webserver started at http://127.0.176.193:37373/ using document root <none> and password file <none>
I20260812 06:16:56.027515 28652 fs_manager.cc:359] Metadata directory not provided
I20260812 06:16:56.027609 28652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:16:56.029289 28652 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:16:56.030112 28736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:56.030303 28652 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:16:56.030429 28652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "48d0fbf07cfa494185380f79add38d48"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "96083e92abe433737b554a2c524c33b0"
server_key_iv: "8f48ceb058f4d496f8db1a658136ee1f"
server_key_version: "encryptionkey@0"
I20260812 06:16:56.030830 28652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:16:56.059369 28652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:16:56.061975 28652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:16:56.062158 28652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:16:56.062427 28652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:16:56.062994 28745 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 06:16:56.065142 28652 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:16:56.065220 28652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 06:16:56.065276 28652 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 06:16:56.065980 28652 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 06:16:56.066040 28652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 06:16:56.066133 28745 tablet_bootstrap.cc:492] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48: Bootstrap starting.
I20260812 06:16:56.074361 28652 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:44499
I20260812 06:16:56.074424 28913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:44499 every 8 connection(s)
I20260812 06:16:56.074848 28652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:16:56.078478 28745 log.cc:824] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48: Log is configured to *not* fsync() on all Append() calls
I20260812 06:16:56.078871 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 28652
I20260812 06:16:56.079494 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:41023
--local_ip_for_outbound_sockets=127.0.176.194
--tserver_master_addrs=127.0.176.254:36167
--webserver_port=42139
--webserver_interface=127.0.176.194
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:16:56.081988 28745 tablet_bootstrap.cc:492] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:16:56.082357 28745 tablet_bootstrap.cc:492] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48: Bootstrap complete.
I20260812 06:16:56.083611 28745 ts_tablet_manager.cc:1397] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.011s
I20260812 06:16:56.085597 28745 raft_consensus.cc:348] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:16:56.086038 28745 raft_consensus.cc:729] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d0fbf07cfa494185380f79add38d48, State: Initialized, Role: FOLLOWER
I20260812 06:16:56.086242 28745 consensus_queue.cc:260] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:16:56.086586 28745 ts_tablet_manager.cc:1428] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
W20260812 06:16:56.148337 28917 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:16:56.075715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:46661)
0812 06:16:56.075902 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:56.075948 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:56.076434 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:56.148157 (+ 71723us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":100,"threads_started":1}
W20260812 06:16:56.148697 28915 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:36167 (0 consecutive failures): Network error: Failed to ping master at 127.0.176.254:36167: Client connection negotiation failed: client connection to 127.0.176.254:36167: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:16:56.149076 28917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:56.148942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:56175)
0812 06:16:56.149001 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:56.149056 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 06:16:56.149518 28917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:56.149391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:51813)
0812 06:16:56.149462 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:56.149494 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 06:16:56.149682 28915 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:16:56.174080 28919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:16:56.174307 28919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:16:56.174333 28919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:16:56.175617 28919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:16:56.175668 28919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:16:56.175715 28919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:16:56.177211 28919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:41023
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=42139
--tserver_master_addrs=127.0.176.254:36167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:16:56.177477 28919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:16:56.177726 28919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:16:56.183151 28933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:56.183262 28930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:56.183156 28928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:56.183777 28919 server_base.cc:1034] running on GCE node
I20260812 06:16:56.184016 28919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:16:56.184297 28919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:16:56.185523 28919 hybrid_clock.cc:648] HybridClock initialized: now 1786515416185490 us; error 38 us; skew 500 ppm
Aug 12 06:16:56 dist-test-slave-gw5c krb5kdc[26766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515416, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:16:56.188555 28919 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:16:56.188995 28919 webserver.cc:460] Webserver started at http://127.0.176.194:42139/ using document root <none> and password file <none>
I20260812 06:16:56.189186 28919 fs_manager.cc:359] Metadata directory not provided
I20260812 06:16:56.189229 28919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:16:56.190635 28919 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:16:56.191238 28943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:56.191478 28919 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:16:56.191574 28919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "c34af7aaa1724906adf4b25703b6a359"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "0a0b8560529b7da06b0c7437f113c52e"
server_key_iv: "62a59e5307c1de491e8c11edbbb854c5"
server_key_version: "encryptionkey@0"
I20260812 06:16:56.191931 28919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:16:56.204430 28919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:16:56.206441 28919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:16:56.206563 28919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:16:56.206868 28919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:16:56.207202 28919 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:16:56.207237 28919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:56.207260 28919 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:16:56.207310 28919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:56.213680 28919 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:41023
I20260812 06:16:56.213771 29127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:41023 every 8 connection(s)
I20260812 06:16:56.214154 28919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:16:56.215543 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:56.215037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:40523)
0812 06:16:56.215224 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:56.215306 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":75,"threads_started":1}
W20260812 06:16:56.215986 29128 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:36167 (0 consecutive failures): Network error: Failed to ping master at 127.0.176.254:36167: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
I20260812 06:16:56.216302 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:56.216192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:53587)
0812 06:16:56.216244 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:56.216271 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 06:16:56.216578 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:56.216490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:60829)
0812 06:16:56.216534 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:56.216555 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:16:56.216883 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 28919
I20260812 06:16:56.217187 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:39057
--local_ip_for_outbound_sockets=127.0.176.195
--tserver_master_addrs=127.0.176.254:36167
--webserver_port=44209
--webserver_interface=127.0.176.195
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:16:56.219182 29128 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:16:56.306794 29131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:16:56.307065 29131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:16:56.307109 29131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:16:56.308451 29131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:16:56.308529 29131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:16:56.308578 29131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:16:56.310165 29131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:39057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=44209
--tserver_master_addrs=127.0.176.254:36167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:16:56.310474 29131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:16:56.310734 29131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:16:56.316092 29144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:16:56.316123 29141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:56.316362 29131 server_base.cc:1034] running on GCE node
W20260812 06:16:56.316124 29142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:16:56.316692 29131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:16:56.316990 29131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:16:56.318193 29131 hybrid_clock.cc:648] HybridClock initialized: now 1786515416318163 us; error 51 us; skew 500 ppm
Aug 12 06:16:56 dist-test-slave-gw5c krb5kdc[26766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515416, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:16:56.321126 29131 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:16:56.321632 29131 webserver.cc:460] Webserver started at http://127.0.176.195:44209/ using document root <none> and password file <none>
I20260812 06:16:56.321884 29131 fs_manager.cc:359] Metadata directory not provided
I20260812 06:16:56.321959 29131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:16:56.323385 29131 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:16:56.324126 29152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:56.324333 29131 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:16:56.324455 29131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "2f1880519c5a42c090b3d03a37a56b19"
format_stamp: "Formatted at 2026-08-12 06:16:14 on dist-test-slave-gw5c"
server_key: "f62202627e83b2c5577dadc45d078226"
server_key_iv: "a7f61405cad9cb98c78e1eb4123d9639"
server_key_version: "encryptionkey@0"
I20260812 06:16:56.324896 29131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:16:56.345144 29131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:16:56.347783 29131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:16:56.347980 29131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:16:56.348256 29131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:16:56.348592 29131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:16:56.348649 29131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:56.348693 29131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:16:56.348722 29131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:16:56.355201 29131 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:39057
I20260812 06:16:56.355249 29326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:39057 every 8 connection(s)
I20260812 06:16:56.355702 29131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:16:56.356868 29330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:56.356461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:60333)
0812 06:16:56.356644 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:56.356724 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":85,"threads_started":1}
W20260812 06:16:56.357332 29328 heartbeater.cc:644] Failed to heartbeat to 127.0.176.254:36167 (0 consecutive failures): Network error: Failed to ping master at 127.0.176.254:36167: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
I20260812 06:16:56.357661 29330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:56.357566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:49155)
0812 06:16:56.357612 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:56.357641 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 06:16:56.358021 29330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:56.357940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:34751)
0812 06:16:56.357983 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:56.358005 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 06:16:56.358144 29328 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:16:56.364926 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 29131
I20260812 06:16:57.150377 29334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:57.150102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:47351)
0812 06:16:57.150266 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:57.150309 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":72,"threads_started":1}
I20260812 06:16:57.219935 29335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:57.219694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:55401)
0812 06:16:57.219823 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:57.219870 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
I20260812 06:16:57.358922 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:57.358638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:32991)
0812 06:16:57.358803 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:57.358854 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":66,"threads_started":1}
I20260812 06:16:57.455368 29339 raft_consensus.cc:482] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:16:57.455547 29339 raft_consensus.cc:504] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:16:57.456164 29339 leader_election.cc:288] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023), 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057)
Aug 12 06:16:57 dist-test-slave-gw5c krb5kdc[26766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515416, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.195@KRBTEST.COM
Aug 12 06:16:57 dist-test-slave-gw5c krb5kdc[26766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515416, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.194@KRBTEST.COM
I20260812 06:16:57.473637 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:57.456471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:38179 (local address 127.0.176.195:39057)
0812 06:16:57.456709 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:57.456719 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:57.456762 (+ 43us) server_negotiation.cc:407] Connection header received
0812 06:16:57.457187 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:57.457190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:57.457231 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:57.457395 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:16:57.458148 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:57.459598 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:57.461210 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:57.461872 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:57.462010 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:57.468998 (+ 6988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:16:57.469004 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:16:57.469005 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:16:57.469028 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:16:57.471060 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:57.471818 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:57.471823 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:57.471823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:57.472003 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:57.472420 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:57.472420 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:57.472421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:57.472814 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:16:57.472914 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:57.473329 (+ 415us) server_negotiation.cc:299] Negotiation successful
0812 06:16:57.473495 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":57,"threads_started":1}
I20260812 06:16:57.473627 29348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:57.456517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:40479 (local address 127.0.176.194:41023)
0812 06:16:57.456676 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 06:16:57.456689 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 06:16:57.456724 (+ 35us) server_negotiation.cc:407] Connection header received
0812 06:16:57.457194 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:16:57.457196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:16:57.457233 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:16:57.457395 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:16:57.458307 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:57.459639 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:57.461210 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:16:57.461872 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:16:57.462010 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:57.469035 (+ 7025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:16:57.469040 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:16:57.469040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:16:57.469052 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:16:57.470932 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:57.471818 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:57.471823 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:57.471823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:57.472002 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:16:57.472411 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:16:57.472412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:16:57.472412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:16:57.472814 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:16:57.472915 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 06:16:57.473329 (+ 414us) server_negotiation.cc:299] Negotiation successful
0812 06:16:57.473495 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":60,"threads_started":1}
I20260812 06:16:57.473771 29334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:57.456368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:39057 (local address 127.0.176.193:38179)
0812 06:16:57.456589 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:57.456602 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:57.456665 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:57.457434 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:57.457437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:57.457817 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:16:57.458007 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:57.458013 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:57.459748 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:57.459749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:57.461074 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:57.461078 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:57.462017 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:57.462017 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:57.462193 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:57.466386 (+ 4193us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:16:57.466402 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:16:57.468606 (+ 2204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:16:57.471129 (+ 2523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:57.471129 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:57.471130 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:57.471583 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:57.472096 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:57.472096 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:57.472096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:57.472321 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:57.472909 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:16:57.472919 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:16:57.473102 (+ 183us) client_negotiation.cc:769] Sending connection context
0812 06:16:57.473247 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 06:16:57.473500 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":57}
I20260812 06:16:57.473861 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:57.456381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:41023 (local address 127.0.176.193:40479)
0812 06:16:57.456530 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:57.456548 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:16:57.456641 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:16:57.457442 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:16:57.457443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:16:57.457818 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:16:57.458007 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:57.458013 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:57.459763 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:57.459764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:57.461074 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:16:57.461078 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:16:57.462015 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:16:57.462017 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:16:57.462193 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:16:57.466386 (+ 4193us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:16:57.466402 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:16:57.468898 (+ 2496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:16:57.471078 (+ 2180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:57.471089 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:57.471092 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:57.471583 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:57.472095 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:16:57.472096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:16:57.472096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:16:57.472321 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:16:57.472909 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:16:57.472919 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:16:57.473102 (+ 183us) client_negotiation.cc:769] Sending connection context
0812 06:16:57.473247 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 06:16:57.473561 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":276,"thread_start_us":87,"threads_started":1}
W20260812 06:16:57.474896 28739 leader_election.cc:341] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057): Not found: Tablet not found: 7b6d10e1c49e4f749d66664cb992376c
W20260812 06:16:57.475309 28741 leader_election.cc:341] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023): Not found: Tablet not found: 7b6d10e1c49e4f749d66664cb992376c
I20260812 06:16:57.475359 28741 leader_election.cc:302] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48d0fbf07cfa494185380f79add38d48; no voters: 2f1880519c5a42c090b3d03a37a56b19, c34af7aaa1724906adf4b25703b6a359
I20260812 06:16:57.475531 29339 raft_consensus.cc:2726] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:16:58.151641 29349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:58.151212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:60245)
0812 06:16:58.151531 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:58.151589 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":81,"threads_started":1}
I20260812 06:16:58.220762 29350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:58.220497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:35749)
0812 06:16:58.220668 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:58.220711 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":66,"threads_started":1}
I20260812 06:16:58.359782 29352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:58.359565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:41295)
0812 06:16:58.359692 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:58.359736 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260812 06:16:59.152547 29353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:59.152272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:60687)
0812 06:16:59.152446 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:59.152498 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":74,"threads_started":1}
I20260812 06:16:59.221593 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:59.221343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:51833)
0812 06:16:59.221495 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:59.221544 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":69,"threads_started":1}
I20260812 06:16:59.360750 29358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:16:59.360385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:35133)
0812 06:16:59.360619 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 06:16:59.360682 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":99,"threads_started":1}
I20260812 06:16:59.382793 29360 raft_consensus.cc:482] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:16:59.382895 29360 raft_consensus.cc:504] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:16:59.383104 29360 leader_election.cc:288] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023), 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057)
W20260812 06:16:59.383517 28741 leader_election.cc:341] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023): Not found: Tablet not found: 7b6d10e1c49e4f749d66664cb992376c
W20260812 06:16:59.383607 28739 leader_election.cc:341] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057): Not found: Tablet not found: 7b6d10e1c49e4f749d66664cb992376c
I20260812 06:16:59.383711 28739 leader_election.cc:302] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48d0fbf07cfa494185380f79add38d48; no voters: 2f1880519c5a42c090b3d03a37a56b19, c34af7aaa1724906adf4b25703b6a359
I20260812 06:16:59.383803 29360 raft_consensus.cc:2726] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:17:00.153494 29361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:00.153203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:41415)
0812 06:17:00.153396 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:00.153444 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":111,"threads_started":1}
I20260812 06:17:00.222434 29362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:00.222159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:59599)
0812 06:17:00.222336 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:00.222384 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":71,"threads_started":1}
I20260812 06:17:00.361531 29363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:00.361307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:39933)
0812 06:17:00.361440 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:00.361483 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":67,"threads_started":1}
I20260812 06:17:01.154475 29364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:01.154210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:39861)
0812 06:17:01.154379 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:01.154427 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":72,"threads_started":1}
I20260812 06:17:01.223297 29366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:01.223060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:48959)
0812 06:17:01.223201 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:01.223246 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
I20260812 06:17:01.362461 29367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:01.362156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:51991)
0812 06:17:01.362361 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:01.362411 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":72,"threads_started":1}
I20260812 06:17:02.155531 29368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:02.155202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:35517)
0812 06:17:02.155373 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:02.155482 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":82,"threads_started":1}
I20260812 06:17:02.224105 29369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:02.223858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:35657)
0812 06:17:02.224011 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:02.224055 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":67,"threads_started":1}
I20260812 06:17:02.315548 29373 raft_consensus.cc:482] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:17:02.315706 29373 raft_consensus.cc:504] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:17:02.315939 29373 leader_election.cc:288] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023), 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057)
W20260812 06:17:02.316490 28739 leader_election.cc:341] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057): Not found: Tablet not found: 7b6d10e1c49e4f749d66664cb992376c
W20260812 06:17:02.316596 28741 leader_election.cc:341] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023): Not found: Tablet not found: 7b6d10e1c49e4f749d66664cb992376c
I20260812 06:17:02.316653 28741 leader_election.cc:302] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48d0fbf07cfa494185380f79add38d48; no voters: 2f1880519c5a42c090b3d03a37a56b19, c34af7aaa1724906adf4b25703b6a359
I20260812 06:17:02.316740 29373 raft_consensus.cc:2726] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:17:02.363334 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:02.363089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:55831)
0812 06:17:02.363235 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:02.363282 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":74,"threads_started":1}
I20260812 06:17:03.156502 29376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:03.156197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:48041)
0812 06:17:03.156401 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:03.156451 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":88,"threads_started":1}
I20260812 06:17:03.224843 29380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:03.224618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:38317)
0812 06:17:03.224758 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:03.224794 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
I20260812 06:17:03.364158 29381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:03.363919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:42833)
0812 06:17:03.364064 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:03.364105 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260812 06:17:04.157266 29383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:04.157023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:53131)
0812 06:17:04.157171 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:04.157216 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":68,"threads_started":1}
I20260812 06:17:04.225719 29385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:04.225467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:42169)
0812 06:17:04.225617 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:04.225666 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":72,"threads_started":1}
I20260812 06:17:04.365036 29386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:04.364753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:51153)
0812 06:17:04.364931 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:04.364981 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":75,"threads_started":1}
I20260812 06:17:05.158226 29389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:05.157992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:60201)
0812 06:17:05.158138 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:05.158178 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260812 06:17:05.226465 29390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:05.226244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:60007)
0812 06:17:05.226375 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:05.226416 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
I20260812 06:17:05.366389 29391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:05.365981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:39479)
0812 06:17:05.366275 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:05.366335 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":195,"threads_started":1}
I20260812 06:17:06.159186 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:06.158898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:51067)
0812 06:17:06.159083 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:06.159132 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":96,"threads_started":1}
I20260812 06:17:06.227173 29394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:06.226945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:48609)
0812 06:17:06.227085 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:06.227126 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":65,"threads_started":1}
I20260812 06:17:06.367298 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:06.367060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:56753)
0812 06:17:06.367197 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:06.367241 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":76,"threads_started":1}
I20260812 06:17:06.848901 29396 raft_consensus.cc:482] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:17:06.849042 29396 raft_consensus.cc:504] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34af7aaa1724906adf4b25703b6a359" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 41023 } } peers { permanent_uuid: "2f1880519c5a42c090b3d03a37a56b19" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 39057 } } peers { permanent_uuid: "48d0fbf07cfa494185380f79add38d48" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44499 } }
I20260812 06:17:06.849248 29396 leader_election.cc:288] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023), 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057)
W20260812 06:17:06.849820 28739 leader_election.cc:341] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2f1880519c5a42c090b3d03a37a56b19 (127.0.176.195:39057): Not found: Tablet not found: 7b6d10e1c49e4f749d66664cb992376c
W20260812 06:17:06.849925 28741 leader_election.cc:341] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c34af7aaa1724906adf4b25703b6a359 (127.0.176.194:41023): Not found: Tablet not found: 7b6d10e1c49e4f749d66664cb992376c
I20260812 06:17:06.850006 28741 leader_election.cc:302] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48d0fbf07cfa494185380f79add38d48; no voters: 2f1880519c5a42c090b3d03a37a56b19, c34af7aaa1724906adf4b25703b6a359
I20260812 06:17:06.850103 29396 raft_consensus.cc:2726] T 7b6d10e1c49e4f749d66664cb992376c P 48d0fbf07cfa494185380f79add38d48 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:17:07.160097 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:07.159831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:37161)
0812 06:17:07.160002 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:07.160048 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":77,"threads_started":1}
I20260812 06:17:07.227916 29400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:07.227648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:42283)
0812 06:17:07.227821 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:07.227857 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":94,"threads_started":1}
I20260812 06:17:07.368026 29401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:07.367781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:52651)
0812 06:17:07.367930 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:07.367978 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":69,"threads_started":1}
I20260812 06:17:08.160961 29403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:08.160725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:36593)
0812 06:17:08.160867 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:08.160913 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":72,"threads_started":1}
I20260812 06:17:08.228665 29404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:08.228424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:54629)
0812 06:17:08.228556 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:08.228617 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
I20260812 06:17:08.368942 29406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:08.368648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:43007)
0812 06:17:08.368831 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:08.368878 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":77,"threads_started":1}
I20260812 06:17:09.161813 29408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:09.161524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:35475)
0812 06:17:09.161714 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:09.161762 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":79,"threads_started":1}
I20260812 06:17:09.229425 29409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:09.229181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:35695)
0812 06:17:09.229321 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:09.229367 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":67,"threads_started":1}
I20260812 06:17:09.369740 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:09.369483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:33545)
0812 06:17:09.369642 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:09.369691 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":69,"threads_started":1}
I20260812 06:17:10.162765 29412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:10.162469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:34475)
0812 06:17:10.162667 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:10.162714 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":94,"threads_started":1}
I20260812 06:17:10.230271 29413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:10.229956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:57299)
0812 06:17:10.230125 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:10.230174 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":85,"threads_started":1}
I20260812 06:17:10.370560 29414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:10.370305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:40641)
0812 06:17:10.370458 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:10.370511 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":75,"threads_started":1}
I20260812 06:17:11.163771 29415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:11.163508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.193:53081)
0812 06:17:11.163663 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:11.163713 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":65,"threads_started":1}
I20260812 06:17:11.231122 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:11.230907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.194:56133)
0812 06:17:11.231036 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:11.231070 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":66,"threads_started":1}
I20260812 06:17:11.368935 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 28652
I20260812 06:17:11.382982 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:11.372808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:36167 (local address 127.0.176.195:44911)
0812 06:17:11.382847 (+ 10039us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:11.382915 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.254:36167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10011,"thread_start_us":1331,"threads_started":1}
I20260812 06:17:11.400745 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 28919
I20260812 06:17:11.416904 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 29131
2026-08-12T06:17:11Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58935 ms)
[----------] 30 tests from SecurityITest (252479 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:11 dist-test-slave-gw5c krb5kdc[29422](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:11 dist-test-slave-gw5c krb5kdc[29422](info): set up 2 sockets
Aug 12 06:17:11 dist-test-slave-gw5c krb5kdc[29422](info): commencing operation
krb5kdc: starting...
W20260812 06:17:12.735436 707 mini_kdc.cc:121] Time spent starting KDC: real 1.292s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:12 dist-test-slave-gw5c krb5kdc[29422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:17:12.870683 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:32927
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:32927
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:12.969734 29442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:12.970036 29442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:12.970082 29442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:12.971511 29442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:12.971643 29442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:12.971675 29442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:12.971709 29442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:12.971731 29442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:12.973614 29442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:32927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:32927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:12.973969 29442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:12.974238 29442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:12.979708 29447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:12.979708 29451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:12.979761 29442 server_base.cc:1034] running on GCE node
W20260812 06:17:12.979743 29449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:12.980384 29442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:12.980674 29442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:12.981828 29442 hybrid_clock.cc:648] HybridClock initialized: now 1786515432981808 us; error 34 us; skew 500 ppm
Aug 12 06:17:12 dist-test-slave-gw5c krb5kdc[29422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515432, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:12.984899 29442 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:17:12.985426 29442 webserver.cc:460] Webserver started at http://127.0.176.254:33693/ using document root <none> and password file <none>
I20260812 06:17:12.985692 29442 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:12.985769 29442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:12.985934 29442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:12.987344 29442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "b906bb4e9bba4026abea0a124045fe19"
format_stamp: "Formatted at 2026-08-12 06:17:12 on dist-test-slave-gw5c"
server_key: "fdcec6d184379bacf195508218357adf"
server_key_iv: "1ba16760b32b52afb8903d39729e59cb"
server_key_version: "encryptionkey@0"
I20260812 06:17:12.987813 29442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "b906bb4e9bba4026abea0a124045fe19"
format_stamp: "Formatted at 2026-08-12 06:17:12 on dist-test-slave-gw5c"
server_key: "fdcec6d184379bacf195508218357adf"
server_key_iv: "1ba16760b32b52afb8903d39729e59cb"
server_key_version: "encryptionkey@0"
I20260812 06:17:12.989308 29442 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:12.990168 29466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:12.990368 29442 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:12.990484 29442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "b906bb4e9bba4026abea0a124045fe19"
format_stamp: "Formatted at 2026-08-12 06:17:12 on dist-test-slave-gw5c"
server_key: "fdcec6d184379bacf195508218357adf"
server_key_iv: "1ba16760b32b52afb8903d39729e59cb"
server_key_version: "encryptionkey@0"
I20260812 06:17:12.990566 29442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:13.001246 29442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:13.004091 29442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:13.004835 29442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:13.009567 29442 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:32927
I20260812 06:17:13.009868 29554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:32927 every 8 connection(s)
I20260812 06:17:13.010035 29442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:13.011029 29555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:13.014071 29555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19: Bootstrap starting.
I20260812 06:17:13.014881 29555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:13.015244 29555 log.cc:824] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:13.016162 29555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19: No bootstrap required, opened a new log
I20260812 06:17:13.017599 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 29442
I20260812 06:17:13.017747 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:13.017969 707 external_mini_cluster.cc:1428] Setting key d7e4ecfbae1db186dbbf7aa8321f50f5
I20260812 06:17:13.018062 29555 raft_consensus.cc:348] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b906bb4e9bba4026abea0a124045fe19" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 32927 } }
I20260812 06:17:13.018291 29555 raft_consensus.cc:374] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:13.018339 29555 raft_consensus.cc:729] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b906bb4e9bba4026abea0a124045fe19, State: Initialized, Role: FOLLOWER
I20260812 06:17:13.018507 29555 consensus_queue.cc:260] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b906bb4e9bba4026abea0a124045fe19" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 32927 } }
I20260812 06:17:13.018604 29555 raft_consensus.cc:388] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:13.018667 29555 raft_consensus.cc:482] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:13.018729 29555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:13.019565 29555 raft_consensus.cc:504] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b906bb4e9bba4026abea0a124045fe19" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 32927 } }
I20260812 06:17:13.019694 29555 leader_election.cc:302] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b906bb4e9bba4026abea0a124045fe19; no voters:
I20260812 06:17:13.019919 29555 leader_election.cc:288] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:13.019939 29562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:13.020083 29562 raft_consensus.cc:686] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [term 1 LEADER]: Becoming Leader. State: Replica: b906bb4e9bba4026abea0a124045fe19, State: Running, Role: LEADER
I20260812 06:17:13.020221 29555 sys_catalog.cc:564] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:13.020239 29562 consensus_queue.cc:237] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b906bb4e9bba4026abea0a124045fe19" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 32927 } }
I20260812 06:17:13.020710 29564 sys_catalog.cc:455] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b906bb4e9bba4026abea0a124045fe19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b906bb4e9bba4026abea0a124045fe19" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 32927 } } }
I20260812 06:17:13.020820 29564 sys_catalog.cc:458] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:13.021118 29566 sys_catalog.cc:455] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b906bb4e9bba4026abea0a124045fe19. Latest consensus state: current_term: 1 leader_uuid: "b906bb4e9bba4026abea0a124045fe19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b906bb4e9bba4026abea0a124045fe19" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 32927 } } }
I20260812 06:17:13.021445 29566 sys_catalog.cc:458] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:13.021246 29577 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:13.022240 29577 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:13.024082 29577 catalog_manager.cc:1347] Generated new cluster ID: fe25a0dbf6f0435bb7bfc4123d5bd5aa
I20260812 06:17:13.024144 29577 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:17:13 dist-test-slave-gw5c krb5kdc[29422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:13.034447 29561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.018595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36384 (local address 127.0.176.254:32927)
0812 06:17:13.019200 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:13.019210 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:13.019250 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:17:13.019382 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:13.019431 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:13.019497 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:13.019674 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:13.020661 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.022201 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.023482 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.024026 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.024145 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.028036 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:13.028041 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:13.028042 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:13.028056 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:13.031348 (+ 3292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:13.033048 (+ 1700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:13.033053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:13.033053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:13.033197 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:13.033433 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:13.033434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:13.033434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:13.033761 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:13.033929 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:13.034057 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 06:17:13.034205 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":478,"threads_started":1}
I20260812 06:17:13.037858 29577 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:13.038375 29577 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:13.043620 29577 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19: Generated new TSK 0
I20260812 06:17:13.043824 29577 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:17:13.073938 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:32927
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:13.163225 29599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:13.163540 29599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:13.163573 29599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:13.164845 29599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:13.164902 29599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:13.164932 29599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:17:13.166585 29599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:32927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:13.166869 29599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:13.167160 29599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:13.174342 29610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:13.174324 29612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:13.174324 29609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:13.175050 29599 server_base.cc:1034] running on GCE node
I20260812 06:17:13.175331 29599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:13.175697 29599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:13.176910 29599 hybrid_clock.cc:648] HybridClock initialized: now 1786515433176878 us; error 49 us; skew 500 ppm
Aug 12 06:17:13 dist-test-slave-gw5c krb5kdc[29422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515433, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:13.179857 29599 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:17:13.180327 29599 webserver.cc:460] Webserver started at http://127.0.176.193:42657/ using document root <none> and password file <none>
I20260812 06:17:13.180531 29599 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:13.180577 29599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:13.180701 29599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:13.181839 29599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "03a6c328ccce47ca96fa0f790ecd5872"
format_stamp: "Formatted at 2026-08-12 06:17:13 on dist-test-slave-gw5c"
server_key: "0f30e93b71b65e7acf3f54279231ffeb"
server_key_iv: "2bbf4ee558d25fca96a4f2d5558fd9ba"
server_key_version: "encryptionkey@0"
I20260812 06:17:13.182190 29599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "03a6c328ccce47ca96fa0f790ecd5872"
format_stamp: "Formatted at 2026-08-12 06:17:13 on dist-test-slave-gw5c"
server_key: "0f30e93b71b65e7acf3f54279231ffeb"
server_key_iv: "2bbf4ee558d25fca96a4f2d5558fd9ba"
server_key_version: "encryptionkey@0"
I20260812 06:17:13.184142 29599 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260812 06:17:13.185129 29619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:13.185384 29599 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:13.185499 29599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "03a6c328ccce47ca96fa0f790ecd5872"
format_stamp: "Formatted at 2026-08-12 06:17:13 on dist-test-slave-gw5c"
server_key: "0f30e93b71b65e7acf3f54279231ffeb"
server_key_iv: "2bbf4ee558d25fca96a4f2d5558fd9ba"
server_key_version: "encryptionkey@0"
I20260812 06:17:13.185599 29599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:13.201417 29599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:13.204401 29599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:13.204581 29599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:13.204893 29599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:13.205250 29599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:13.205286 29599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:13.205317 29599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:13.205367 29599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:13.212240 29599 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:35107
I20260812 06:17:13.212329 29797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:35107 every 8 connection(s)
I20260812 06:17:13.212683 29599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:17:13 dist-test-slave-gw5c krb5kdc[29422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515433, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:13.220805 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 29599
I20260812 06:17:13.221055 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:17:13.221490 707 external_mini_cluster.cc:1428] Setting key 251ac3115b9c7450e5157e0db81bd5c1
I20260812 06:17:13.223711 29561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.213511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:45131 (local address 127.0.176.254:32927)
0812 06:17:13.213559 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:13.213561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:13.213827 (+ 266us) server_negotiation.cc:407] Connection header received
0812 06:17:13.214812 (+ 985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:13.214813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:13.214831 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:13.214874 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:13.215627 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.216148 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.217181 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.217447 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.217532 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.219890 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:13.219892 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:13.219892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:13.219901 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:13.222078 (+ 2177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:13.222612 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:13.222613 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:13.222614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:13.222677 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:13.222957 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:13.222958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:13.222958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:13.223085 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:13.223156 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:13.223516 (+ 360us) server_negotiation.cc:299] Negotiation successful
0812 06:17:13.223618 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:17:13.223937 29803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.213497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:32927 (local address 127.0.176.193:45131)
0812 06:17:13.213687 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:13.213725 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:13.214693 (+ 968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:13.214954 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:13.214958 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:13.215239 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:13.215534 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.215540 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.216254 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.216255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.217088 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.217090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.217543 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.217544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.217681 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.218212 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:13.218221 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:13.219770 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:13.222159 (+ 2389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:13.222172 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:13.222174 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:13.222531 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:13.222753 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:13.222754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:13.222754 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:13.222880 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:13.223158 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:13.223166 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:13.223327 (+ 161us) client_negotiation.cc:769] Sending connection context
0812 06:17:13.223489 (+ 162us) client_negotiation.cc:240] Negotiation successful
0812 06:17:13.223669 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":101,"threads_started":1}
I20260812 06:17:13.224440 29799 heartbeater.cc:347] Connected to a master server at 127.0.176.254:32927
I20260812 06:17:13.224541 29799 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:13.224750 29799 heartbeater.cc:511] Master 127.0.176.254:32927 requested a full tablet report, sending...
I20260812 06:17:13.225310 29499 ts_manager.cc:194] Registered new tserver with Master: 03a6c328ccce47ca96fa0f790ecd5872 (127.0.176.193:35107)
I20260812 06:17:13.225932 29499 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:45131
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:17:13.250927 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:32927
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:13.338474 29808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:13.338742 29808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:13.338785 29808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:13.340106 29808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:13.340185 29808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:13.340234 29808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:17:13.341914 29808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:32927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:13.342219 29808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:13.342470 29808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:13.347726 29815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:13.347725 29813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:13.347712 29820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:13.348294 29808 server_base.cc:1034] running on GCE node
I20260812 06:17:13.348556 29808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:13.348846 29808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:13.350033 29808 hybrid_clock.cc:648] HybridClock initialized: now 1786515433350036 us; error 49 us; skew 500 ppm
Aug 12 06:17:13 dist-test-slave-gw5c krb5kdc[29422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515433, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:13.352763 29808 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:17:13.353288 29808 webserver.cc:460] Webserver started at http://127.0.176.194:46525/ using document root <none> and password file <none>
I20260812 06:17:13.353535 29808 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:13.353602 29808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:13.353765 29808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:13.354913 29808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "32e7c82658b446f7b3a076afb65b5386"
format_stamp: "Formatted at 2026-08-12 06:17:13 on dist-test-slave-gw5c"
server_key: "72446eb2eea6d046ffeaf0684485f062"
server_key_iv: "327ea8efcfa7cb83659f8fb24145bd65"
server_key_version: "encryptionkey@0"
I20260812 06:17:13.355307 29808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "32e7c82658b446f7b3a076afb65b5386"
format_stamp: "Formatted at 2026-08-12 06:17:13 on dist-test-slave-gw5c"
server_key: "72446eb2eea6d046ffeaf0684485f062"
server_key_iv: "327ea8efcfa7cb83659f8fb24145bd65"
server_key_version: "encryptionkey@0"
I20260812 06:17:13.356869 29808 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:13.357935 29832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:13.358219 29808 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:13.358451 29808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "32e7c82658b446f7b3a076afb65b5386"
format_stamp: "Formatted at 2026-08-12 06:17:13 on dist-test-slave-gw5c"
server_key: "72446eb2eea6d046ffeaf0684485f062"
server_key_iv: "327ea8efcfa7cb83659f8fb24145bd65"
server_key_version: "encryptionkey@0"
I20260812 06:17:13.358546 29808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:13.368098 29808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:13.370412 29808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:13.370594 29808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:13.370848 29808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:13.371284 29808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:13.371343 29808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:13.371378 29808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:13.371474 29808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:13.379362 29808 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:37341
I20260812 06:17:13.379449 30009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:37341 every 8 connection(s)
I20260812 06:17:13.379798 29808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:17:13 dist-test-slave-gw5c krb5kdc[29422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515433, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:13.387687 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 29808
I20260812 06:17:13.387836 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:17:13.388206 707 external_mini_cluster.cc:1428] Setting key 586e4498c48cfa6cd5c0da426eafda48
I20260812 06:17:13.391217 29561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.380565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:45917 (local address 127.0.176.254:32927)
0812 06:17:13.380622 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:13.380625 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:13.380854 (+ 229us) server_negotiation.cc:407] Connection header received
0812 06:17:13.381813 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:13.381815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:13.381827 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:13.381882 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:13.382517 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.383036 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.384149 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.384362 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.384422 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.386719 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:13.386721 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:13.386721 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:13.386737 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:13.389652 (+ 2915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:13.390165 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:13.390167 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:13.390167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:13.390235 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:13.390501 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:13.390502 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:13.390503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:13.390641 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:13.390722 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:13.391028 (+ 306us) server_negotiation.cc:299] Negotiation successful
0812 06:17:13.391120 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:17:13.391476 30014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.380531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:32927 (local address 127.0.176.194:45917)
0812 06:17:13.380697 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:13.380737 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:13.381708 (+ 971us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:13.381940 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:13.381943 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:13.382220 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:13.382429 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.382434 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.383129 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.383130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.384057 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.384060 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.384452 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.384453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.384562 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.385130 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:13.385139 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:13.386609 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:13.389759 (+ 3150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:13.389775 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:13.389778 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:13.390080 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:13.390307 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:13.390308 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:13.390309 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:13.390433 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:13.390712 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:13.390720 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:13.390878 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 06:17:13.390996 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 06:17:13.391188 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":96,"threads_started":1}
I20260812 06:17:13.391978 30011 heartbeater.cc:347] Connected to a master server at 127.0.176.254:32927
I20260812 06:17:13.392110 30011 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:13.392340 30011 heartbeater.cc:511] Master 127.0.176.254:32927 requested a full tablet report, sending...
I20260812 06:17:13.393000 29499 ts_manager.cc:194] Registered new tserver with Master: 32e7c82658b446f7b3a076afb65b5386 (127.0.176.194:37341)
I20260812 06:17:13.393473 29499 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:45917
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:17:13.419234 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:32927
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:39767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:13.511127 30019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:13.511392 30019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:13.511461 30019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:13.512667 30019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:13.512740 30019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:13.512799 30019 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:17:13.514384 30019 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:39767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:32927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:13.514686 30019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:13.514954 30019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:13.520356 30029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:13.520349 30034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:13.520349 30030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:13.520677 30019 server_base.cc:1034] running on GCE node
I20260812 06:17:13.520932 30019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:13.521260 30019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:13.522449 30019 hybrid_clock.cc:648] HybridClock initialized: now 1786515433522443 us; error 46 us; skew 500 ppm
Aug 12 06:17:13 dist-test-slave-gw5c krb5kdc[29422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515433, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:13.525528 30019 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:17:13.526021 30019 webserver.cc:460] Webserver started at http://127.0.176.195:36937/ using document root <none> and password file <none>
I20260812 06:17:13.526289 30019 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:13.526360 30019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:13.526513 30019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:13.527702 30019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "5ab253148123479ebb0906015dc3ebf4"
format_stamp: "Formatted at 2026-08-12 06:17:13 on dist-test-slave-gw5c"
server_key: "62cddbdb674c6b4edf91c3e46d0c099f"
server_key_iv: "59b3b75f435923dc8f0d4f59ca2617c6"
server_key_version: "encryptionkey@0"
I20260812 06:17:13.528077 30019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "5ab253148123479ebb0906015dc3ebf4"
format_stamp: "Formatted at 2026-08-12 06:17:13 on dist-test-slave-gw5c"
server_key: "62cddbdb674c6b4edf91c3e46d0c099f"
server_key_iv: "59b3b75f435923dc8f0d4f59ca2617c6"
server_key_version: "encryptionkey@0"
I20260812 06:17:13.529598 30019 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:13.530640 30043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:13.531019 30019 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:13.531159 30019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "5ab253148123479ebb0906015dc3ebf4"
format_stamp: "Formatted at 2026-08-12 06:17:13 on dist-test-slave-gw5c"
server_key: "62cddbdb674c6b4edf91c3e46d0c099f"
server_key_iv: "59b3b75f435923dc8f0d4f59ca2617c6"
server_key_version: "encryptionkey@0"
I20260812 06:17:13.531247 30019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:13.550587 30019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:13.552866 30019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:13.553045 30019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:13.553301 30019 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:13.553650 30019 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:13.553706 30019 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:13.553752 30019 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:13.553777 30019 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:13.560577 30019 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:37559
I20260812 06:17:13.560623 30222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:37559 every 8 connection(s)
I20260812 06:17:13.560984 30019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:17:13.566251 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 30019
I20260812 06:17:13.566382 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:17:13.566625 707 external_mini_cluster.cc:1428] Setting key 48e7f1f14d664164f5bbe9ce472623b5
Aug 12 06:17:13 dist-test-slave-gw5c krb5kdc[29422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515433, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:13.571759 29561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.561874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:45665 (local address 127.0.176.254:32927)
0812 06:17:13.561921 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:13.561924 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:13.562150 (+ 226us) server_negotiation.cc:407] Connection header received
0812 06:17:13.563173 (+ 1023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:13.563174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:13.563185 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:13.563246 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:13.563991 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.564514 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.565694 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.565909 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.565978 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.568713 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:13.568715 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:13.568716 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:13.568724 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:13.570200 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:13.570655 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:13.570656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:13.570657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:13.570724 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:13.570993 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:13.570994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:13.570995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:13.571125 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:13.571202 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:13.571576 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 06:17:13.571661 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:17:13.571980 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.561829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:32927 (local address 127.0.176.195:45665)
0812 06:17:13.562016 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:13.562061 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:13.563076 (+ 1015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:13.563310 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:13.563313 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:13.563673 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:13.563877 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.563882 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.564701 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.564702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.565569 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.565571 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.566116 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.566118 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.566287 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.566989 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:13.566998 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:13.568590 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:13.570301 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:13.570310 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:13.570313 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:13.570573 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:13.570802 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:13.570803 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:13.570803 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:13.570921 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:13.571208 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:13.571216 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:13.571365 (+ 149us) client_negotiation.cc:769] Sending connection context
0812 06:17:13.571539 (+ 174us) client_negotiation.cc:240] Negotiation successful
0812 06:17:13.571724 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":96,"threads_started":1}
I20260812 06:17:13.572712 30223 heartbeater.cc:347] Connected to a master server at 127.0.176.254:32927
I20260812 06:17:13.572830 30223 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:13.573038 30223 heartbeater.cc:511] Master 127.0.176.254:32927 requested a full tablet report, sending...
I20260812 06:17:13.573537 29499 ts_manager.cc:194] Registered new tserver with Master: 5ab253148123479ebb0906015dc3ebf4 (127.0.176.195:37559)
I20260812 06:17:13.573953 29499 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:45665
I20260812 06:17:13.578435 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:17:13.586335 29561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.579888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36386 (local address 127.0.176.254:32927)
0812 06:17:13.579958 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:13.579960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:13.580077 (+ 117us) server_negotiation.cc:407] Connection header received
0812 06:17:13.580123 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:13.580124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:13.580135 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:13.580189 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:13.580769 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.581283 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.582061 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.582252 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.582332 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.583737 (+ 1405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:13.583738 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:13.583738 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:13.583753 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:13.585197 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:13.585535 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:13.585536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:13.585536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:13.585586 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:13.585790 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:13.585790 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:13.585791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:13.585945 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:13.586019 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:13.586117 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 06:17:13.586176 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:17:13.588467 29499 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36386:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:17:13.590493 29499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:17:13.597886 30240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.593457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:37341 (local address 127.0.0.1:40722)
0812 06:17:13.593581 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:13.593591 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:13.593634 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:13.594242 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:13.594243 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:13.594245 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:13.594304 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.594307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.595847 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.595848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.596847 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.596849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.597515 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.597516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.597613 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.597630 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 06:17:13.597739 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 06:17:13.597798 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":89,"threads_started":1}
I20260812 06:17:13.597898 30242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.593738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40722 (local address 127.0.176.194:37341)
0812 06:17:13.593923 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:13.593928 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:13.593937 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:17:13.593969 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:13.593971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:13.594004 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:13.594087 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:13.594411 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.595732 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.596930 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.597424 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.597515 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.597580 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:13.597761 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 06:17:13.597804 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":94,"threads_started":1}
I20260812 06:17:13.598070 30236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.593219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:35107 (local address 127.0.0.1:36086)
0812 06:17:13.593448 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:13.593491 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:13.593604 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:13.594179 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:13.594182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:13.594184 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:13.594285 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.594288 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.595337 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.595338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.596576 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.596579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.597827 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.597828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.597895 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.597899 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:13.597947 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:17:13.597993 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":1,"thread_start_us":81,"threads_started":1}
I20260812 06:17:13.598306 30239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.593355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36086 (local address 127.0.176.193:35107)
0812 06:17:13.593970 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:13.593976 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:13.593989 (+ 13us) server_negotiation.cc:407] Connection header received
0812 06:17:13.594037 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:13.594039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:13.594070 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:13.594154 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:13.594390 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.595225 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.596679 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.597661 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.597739 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.597790 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:13.598152 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 06:17:13.598201 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":102,"threads_started":1}
I20260812 06:17:13.598654 30237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.593229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:37559 (local address 127.0.0.1:49990)
0812 06:17:13.593552 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:13.593564 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:13.593631 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:13.594536 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:13.594537 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:13.594541 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:13.594588 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.594590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.596147 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.596149 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.597156 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.597160 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.598417 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.598418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.598484 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.598489 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:17:13.598520 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 06:17:13.598566 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":92,"threads_started":1}
I20260812 06:17:13.599020 30238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.593347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49990 (local address 127.0.176.195:37559)
0812 06:17:13.594337 (+ 990us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:13.594342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:13.594354 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:17:13.594404 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:13.594406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:13.594423 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:13.594807 (+ 384us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:13.594917 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.596029 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.597265 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.598311 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.598759 (+ 448us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.598834 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:13.598861 (+ 27us) server_negotiation.cc:299] Negotiation successful
0812 06:17:13.598922 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":947,"thread_start_us":98,"threads_started":1}
I20260812 06:17:13.599131 29904 tablet_service.cc:1467] Processing CreateTablet for tablet 92be73f6f22846119ace30eb46cbf62a (DEFAULT_TABLE table=test-table [id=ad3f3513c4a546f4983de67bbfd23463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:13.599802 29904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92be73f6f22846119ace30eb46cbf62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:13.599691 29692 tablet_service.cc:1467] Processing CreateTablet for tablet 92be73f6f22846119ace30eb46cbf62a (DEFAULT_TABLE table=test-table [id=ad3f3513c4a546f4983de67bbfd23463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:13.599756 30115 tablet_service.cc:1467] Processing CreateTablet for tablet 92be73f6f22846119ace30eb46cbf62a (DEFAULT_TABLE table=test-table [id=ad3f3513c4a546f4983de67bbfd23463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:13.600063 29692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92be73f6f22846119ace30eb46cbf62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:13.600093 30115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92be73f6f22846119ace30eb46cbf62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:13.602810 30243 tablet_bootstrap.cc:492] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4: Bootstrap starting.
I20260812 06:17:13.603729 30243 tablet_bootstrap.cc:654] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:13.603704 30244 tablet_bootstrap.cc:492] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386: Bootstrap starting.
I20260812 06:17:13.604060 30245 tablet_bootstrap.cc:492] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872: Bootstrap starting.
I20260812 06:17:13.604455 30244 tablet_bootstrap.cc:654] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:13.604498 30243 log.cc:824] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:13.604715 30245 tablet_bootstrap.cc:654] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:13.605075 30244 log.cc:824] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:13.605376 30245 log.cc:824] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:13.605429 30243 tablet_bootstrap.cc:492] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4: No bootstrap required, opened a new log
I20260812 06:17:13.605516 30243 ts_tablet_manager.cc:1397] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:17:13.605899 30244 tablet_bootstrap.cc:492] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386: No bootstrap required, opened a new log
I20260812 06:17:13.605973 30244 ts_tablet_manager.cc:1397] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:17:13.606138 30245 tablet_bootstrap.cc:492] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872: No bootstrap required, opened a new log
I20260812 06:17:13.606218 30245 ts_tablet_manager.cc:1397] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:17:13.607645 30243 raft_consensus.cc:348] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab253148123479ebb0906015dc3ebf4" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37559 } } peers { permanent_uuid: "03a6c328ccce47ca96fa0f790ecd5872" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35107 } } peers { permanent_uuid: "32e7c82658b446f7b3a076afb65b5386" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37341 } }
I20260812 06:17:13.607846 30243 raft_consensus.cc:374] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:13.607930 30243 raft_consensus.cc:729] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ab253148123479ebb0906015dc3ebf4, State: Initialized, Role: FOLLOWER
I20260812 06:17:13.608083 30243 consensus_queue.cc:260] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab253148123479ebb0906015dc3ebf4" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37559 } } peers { permanent_uuid: "03a6c328ccce47ca96fa0f790ecd5872" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35107 } } peers { permanent_uuid: "32e7c82658b446f7b3a076afb65b5386" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37341 } }
I20260812 06:17:13.608052 30245 raft_consensus.cc:348] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab253148123479ebb0906015dc3ebf4" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37559 } } peers { permanent_uuid: "03a6c328ccce47ca96fa0f790ecd5872" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35107 } } peers { permanent_uuid: "32e7c82658b446f7b3a076afb65b5386" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37341 } }
I20260812 06:17:13.608238 30245 raft_consensus.cc:374] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:13.608322 30245 raft_consensus.cc:729] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03a6c328ccce47ca96fa0f790ecd5872, State: Initialized, Role: FOLLOWER
I20260812 06:17:13.608420 30223 heartbeater.cc:503] Master 127.0.176.254:32927 was elected leader, sending a full tablet report...
I20260812 06:17:13.608385 30244 raft_consensus.cc:348] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab253148123479ebb0906015dc3ebf4" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37559 } } peers { permanent_uuid: "03a6c328ccce47ca96fa0f790ecd5872" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35107 } } peers { permanent_uuid: "32e7c82658b446f7b3a076afb65b5386" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37341 } }
I20260812 06:17:13.608556 30244 raft_consensus.cc:374] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:13.608597 30244 raft_consensus.cc:729] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32e7c82658b446f7b3a076afb65b5386, State: Initialized, Role: FOLLOWER
I20260812 06:17:13.608417 30243 ts_tablet_manager.cc:1428] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:17:13.608613 30245 consensus_queue.cc:260] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab253148123479ebb0906015dc3ebf4" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37559 } } peers { permanent_uuid: "03a6c328ccce47ca96fa0f790ecd5872" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35107 } } peers { permanent_uuid: "32e7c82658b446f7b3a076afb65b5386" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37341 } }
I20260812 06:17:13.608731 30244 consensus_queue.cc:260] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab253148123479ebb0906015dc3ebf4" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37559 } } peers { permanent_uuid: "03a6c328ccce47ca96fa0f790ecd5872" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35107 } } peers { permanent_uuid: "32e7c82658b446f7b3a076afb65b5386" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37341 } }
I20260812 06:17:13.608925 30245 ts_tablet_manager.cc:1428] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:17:13.609205 29799 heartbeater.cc:503] Master 127.0.176.254:32927 was elected leader, sending a full tablet report...
I20260812 06:17:13.609946 30244 ts_tablet_manager.cc:1428] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 06:17:13.610066 30011 heartbeater.cc:503] Master 127.0.176.254:32927 was elected leader, sending a full tablet report...
W20260812 06:17:13.630425 30012 tablet.cc:2369] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:17:13.699278 30255 raft_consensus.cc:482] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:17:13.699458 30255 raft_consensus.cc:504] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab253148123479ebb0906015dc3ebf4" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37559 } } peers { permanent_uuid: "03a6c328ccce47ca96fa0f790ecd5872" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35107 } } peers { permanent_uuid: "32e7c82658b446f7b3a076afb65b5386" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37341 } }
I20260812 06:17:13.699844 30255 leader_election.cc:288] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ab253148123479ebb0906015dc3ebf4 (127.0.176.195:37559), 32e7c82658b446f7b3a076afb65b5386 (127.0.176.194:37341)
I20260812 06:17:13.702911 30238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.700158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:42123 (local address 127.0.176.195:37559)
0812 06:17:13.700222 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:13.700224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:13.700237 (+ 13us) server_negotiation.cc:407] Connection header received
0812 06:17:13.700295 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:13.700296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:13.700310 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:13.700383 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:13.700580 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.701119 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.702128 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.702523 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.702583 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.702614 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:13.702775 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 06:17:13.702834 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:17:13.702929 29803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.700062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:37559 (local address 127.0.176.193:42123)
0812 06:17:13.700127 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:13.700141 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:13.700229 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:13.700402 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:13.700403 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:13.700406 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:13.700490 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.700493 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.701205 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.701206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.702022 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.702024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.702610 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.702612 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.702700 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.702703 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:17:13.702746 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:17:13.702781 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 06:17:13.702946 30242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.700291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:33557 (local address 127.0.176.194:37341)
0812 06:17:13.700346 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:13.700348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:13.700414 (+ 66us) server_negotiation.cc:407] Connection header received
0812 06:17:13.700476 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:13.700477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:13.700486 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:13.700551 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:13.700729 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.701206 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.702156 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.702537 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.702629 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.702638 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:13.702832 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 06:17:13.702883 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:17:13.702952 30258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.700175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:37341 (local address 127.0.176.193:33557)
0812 06:17:13.700348 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:13.700358 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:13.700414 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:13.700578 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:13.700579 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:13.700581 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:13.700658 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.700660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.701303 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.701304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.702031 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:13.702033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.702656 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.702661 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:13.702745 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.702749 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:13.702810 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:17:13.702846 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":96,"threads_started":1}
I20260812 06:17:13.703351 29942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92be73f6f22846119ace30eb46cbf62a" candidate_uuid: "03a6c328ccce47ca96fa0f790ecd5872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32e7c82658b446f7b3a076afb65b5386" is_pre_election: true
I20260812 06:17:13.703368 30147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92be73f6f22846119ace30eb46cbf62a" candidate_uuid: "03a6c328ccce47ca96fa0f790ecd5872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ab253148123479ebb0906015dc3ebf4" is_pre_election: true
I20260812 06:17:13.703565 30147 raft_consensus.cc:2454] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03a6c328ccce47ca96fa0f790ecd5872 in term 0.
I20260812 06:17:13.703569 29942 raft_consensus.cc:2454] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03a6c328ccce47ca96fa0f790ecd5872 in term 0.
I20260812 06:17:13.703827 29623 leader_election.cc:302] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a6c328ccce47ca96fa0f790ecd5872, 5ab253148123479ebb0906015dc3ebf4; no voters:
I20260812 06:17:13.703996 30255 raft_consensus.cc:2781] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:17:13.704061 30255 raft_consensus.cc:482] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:17:13.704110 30255 raft_consensus.cc:3037] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:13.704839 30255 raft_consensus.cc:504] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab253148123479ebb0906015dc3ebf4" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37559 } } peers { permanent_uuid: "03a6c328ccce47ca96fa0f790ecd5872" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35107 } } peers { permanent_uuid: "32e7c82658b446f7b3a076afb65b5386" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37341 } }
I20260812 06:17:13.704985 30255 leader_election.cc:288] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [CANDIDATE]: Term 1 election: Requested vote from peers 5ab253148123479ebb0906015dc3ebf4 (127.0.176.195:37559), 32e7c82658b446f7b3a076afb65b5386 (127.0.176.194:37341)
I20260812 06:17:13.705161 30147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92be73f6f22846119ace30eb46cbf62a" candidate_uuid: "03a6c328ccce47ca96fa0f790ecd5872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ab253148123479ebb0906015dc3ebf4"
I20260812 06:17:13.705186 29942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92be73f6f22846119ace30eb46cbf62a" candidate_uuid: "03a6c328ccce47ca96fa0f790ecd5872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32e7c82658b446f7b3a076afb65b5386"
I20260812 06:17:13.705271 30147 raft_consensus.cc:3037] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:13.705268 29942 raft_consensus.cc:3037] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:13.706028 29942 raft_consensus.cc:2454] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a6c328ccce47ca96fa0f790ecd5872 in term 1.
I20260812 06:17:13.706092 30147 raft_consensus.cc:2454] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a6c328ccce47ca96fa0f790ecd5872 in term 1.
I20260812 06:17:13.706213 29623 leader_election.cc:302] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a6c328ccce47ca96fa0f790ecd5872, 32e7c82658b446f7b3a076afb65b5386; no voters:
I20260812 06:17:13.706342 30255 raft_consensus.cc:2781] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:13.706570 30255 raft_consensus.cc:686] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [term 1 LEADER]: Becoming Leader. State: Replica: 03a6c328ccce47ca96fa0f790ecd5872, State: Running, Role: LEADER
I20260812 06:17:13.706684 30255 consensus_queue.cc:237] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab253148123479ebb0906015dc3ebf4" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37559 } } peers { permanent_uuid: "03a6c328ccce47ca96fa0f790ecd5872" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35107 } } peers { permanent_uuid: "32e7c82658b446f7b3a076afb65b5386" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37341 } }
I20260812 06:17:13.709062 29499 catalog_manager.cc:5495] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03a6c328ccce47ca96fa0f790ecd5872 (127.0.176.193). New cstate: current_term: 1 leader_uuid: "03a6c328ccce47ca96fa0f790ecd5872" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab253148123479ebb0906015dc3ebf4" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a6c328ccce47ca96fa0f790ecd5872" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 35107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32e7c82658b446f7b3a076afb65b5386" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37341 } health_report { overall_health: UNKNOWN } } }
W20260812 06:17:13.713466 29801 tablet.cc:2369] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:17:13.715862 30239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.713386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36100 (local address 127.0.176.193:35107)
0812 06:17:13.713429 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:13.713431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:13.713464 (+ 33us) server_negotiation.cc:407] Connection header received
0812 06:17:13.713566 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:13.713567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:13.713588 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:13.713671 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:13.713808 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.714273 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.715007 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.715193 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.715248 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.715447 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:13.715561 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:13.715739 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:13.715757 (+ 18us) server_negotiation.cc:299] Negotiation successful
0812 06:17:13.715779 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:17:13.717835 30147 raft_consensus.cc:1261] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4 [term 1 FOLLOWER]: Refusing update from remote peer 03a6c328ccce47ca96fa0f790ecd5872: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:13.717844 29942 raft_consensus.cc:1261] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386 [term 1 FOLLOWER]: Refusing update from remote peer 03a6c328ccce47ca96fa0f790ecd5872: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:13.718179 30255 consensus_queue.cc:1035] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ab253148123479ebb0906015dc3ebf4" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:13.718335 30261 consensus_queue.cc:1035] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32e7c82658b446f7b3a076afb65b5386" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 37341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:13.720945 30266 mvcc.cc:205] Tried to move back new op lower bound from 7317567216505085952 to 7317567216463233024. Current Snapshot: MvccSnapshot[applied={T|T < 7317567216505085952}]
I20260812 06:17:13.724180 29497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36386:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:17:13.724304 29497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36386:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:17:13.725147 29497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b906bb4e9bba4026abea0a124045fe19: Sending DeleteTablet for 3 replicas of tablet 92be73f6f22846119ace30eb46cbf62a
I20260812 06:17:13.725482 29692 tablet_service.cc:1514] Processing DeleteTablet for tablet 92be73f6f22846119ace30eb46cbf62a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:13 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:36086
I20260812 06:17:13.725549 29904 tablet_service.cc:1514] Processing DeleteTablet for tablet 92be73f6f22846119ace30eb46cbf62a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:13 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:40722
I20260812 06:17:13.725525 30115 tablet_service.cc:1514] Processing DeleteTablet for tablet 92be73f6f22846119ace30eb46cbf62a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:13 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:49990
I20260812 06:17:13.725796 30283 tablet_replica.cc:330] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872: stopping tablet replica
I20260812 06:17:13.725937 30283 raft_consensus.cc:2229] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:17:13.726076 30283 raft_consensus.cc:2258] T 92be73f6f22846119ace30eb46cbf62a P 03a6c328ccce47ca96fa0f790ecd5872 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:13.726145 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 29599
I20260812 06:17:13.734736 30285 tablet_replica.cc:330] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4: stopping tablet replica
I20260812 06:17:13.734934 30285 raft_consensus.cc:2229] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:17:13.735085 30285 raft_consensus.cc:2258] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:13.735307 30284 tablet_replica.cc:330] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386: stopping tablet replica
I20260812 06:17:13.735469 30284 raft_consensus.cc:2229] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:17:13.735587 30284 raft_consensus.cc:2258] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:13.735720 30285 ts_tablet_manager.cc:1905] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:17:13.736055 30284 ts_tablet_manager.cc:1905] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:17:13.737294 30285 ts_tablet_manager.cc:1918] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:17:13.737398 30285 log.cc:1196] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/92be73f6f22846119ace30eb46cbf62a
I20260812 06:17:13.737674 30285 ts_tablet_manager.cc:1939] T 92be73f6f22846119ace30eb46cbf62a P 5ab253148123479ebb0906015dc3ebf4: Deleting consensus metadata
I20260812 06:17:13.738111 30284 ts_tablet_manager.cc:1918] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:17:13.738193 30284 log.cc:1196] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/92be73f6f22846119ace30eb46cbf62a
I20260812 06:17:13.738189 29471 catalog_manager.cc:4841] TS 5ab253148123479ebb0906015dc3ebf4 (127.0.176.195:37559): tablet 92be73f6f22846119ace30eb46cbf62a (table test-table [id=ad3f3513c4a546f4983de67bbfd23463]) successfully deleted
I20260812 06:17:13.738540 30284 ts_tablet_manager.cc:1939] T 92be73f6f22846119ace30eb46cbf62a P 32e7c82658b446f7b3a076afb65b5386: Deleting consensus metadata
I20260812 06:17:13.739008 29471 catalog_manager.cc:4841] TS 32e7c82658b446f7b3a076afb65b5386 (127.0.176.194:37341): tablet 92be73f6f22846119ace30eb46cbf62a (table test-table [id=ad3f3513c4a546f4983de67bbfd23463]) successfully deleted
W20260812 06:17:13.739979 29474 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:35107 (error 108)
I20260812 06:17:13.740231 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 29808
I20260812 06:17:13.740557 30240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.740435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:35107 (local address 127.0.0.1:36114)
0812 06:17:13.740483 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:13.740518 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 06:17:13.740687 29474 catalog_manager.cc:4584] TS 03a6c328ccce47ca96fa0f790ecd5872 (127.0.176.193:35107): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 92be73f6f22846119ace30eb46cbf62a: Network error: Client connection negotiation failed: client connection to 127.0.176.193:35107: connect: Connection refused (error 111)
I20260812 06:17:13.752171 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 30019
I20260812 06:17:13.784844 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 29442
2026-08-12T06:17:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2370 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T06:17:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:13Z Disabled control of system clock
I20260812 06:17:13.821786 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42149
--webserver_interface=127.0.176.254
--webserver_port=0
--builtin_ntp_servers=127.0.176.212:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:42149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:17:13.910475 30294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:13.910789 30294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:13.910812 30294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:13.912088 30294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:13.912133 30294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:13.912146 30294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:13.912159 30294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:13.912216 30294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:13.913630 30294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:42149
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:13.913924 30294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:13.914263 30294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:13.919319 30302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:13.919376 30304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:13.919335 30308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:13.919456 30294 server_base.cc:1034] running on GCE node
I20260812 06:17:13.919916 30294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:13.920249 30294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:13.921406 30294 hybrid_clock.cc:648] HybridClock initialized: now 1786515433921397 us; error 35 us; skew 500 ppm
I20260812 06:17:13.922694 30294 webserver.cc:460] Webserver started at http://127.0.176.254:35881/ using document root <none> and password file <none>
I20260812 06:17:13.922966 30294 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:13.923014 30294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:13.923189 30294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:13.924391 30294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "48c7b20b284f47439e8fdf00d8ce68ff"
format_stamp: "Formatted at 2026-08-12 06:17:13 on dist-test-slave-gw5c"
server_key: "b9078654aadfa4a1d2e2c1315db2bf84"
server_key_iv: "69017206513ba2b7f721a645035e9a45"
server_key_version: "encryptionkey@0"
I20260812 06:17:13.924786 30294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "48c7b20b284f47439e8fdf00d8ce68ff"
format_stamp: "Formatted at 2026-08-12 06:17:13 on dist-test-slave-gw5c"
server_key: "b9078654aadfa4a1d2e2c1315db2bf84"
server_key_iv: "69017206513ba2b7f721a645035e9a45"
server_key_version: "encryptionkey@0"
I20260812 06:17:13.926163 30294 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:17:13.926990 30320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:13.927196 30294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:13.927307 30294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "48c7b20b284f47439e8fdf00d8ce68ff"
format_stamp: "Formatted at 2026-08-12 06:17:13 on dist-test-slave-gw5c"
server_key: "b9078654aadfa4a1d2e2c1315db2bf84"
server_key_iv: "69017206513ba2b7f721a645035e9a45"
server_key_version: "encryptionkey@0"
I20260812 06:17:13.927388 30294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:13.946971 30294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:13.947360 30294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:13.947602 30294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:13.951956 30294 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:42149
I20260812 06:17:13.951992 30405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:42149 every 8 connection(s)
I20260812 06:17:13.952364 30294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:13.953439 30406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:13.955920 30406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff: Bootstrap starting.
I20260812 06:17:13.956532 30406 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:13.956838 30406 log.cc:824] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:13.957615 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 30294
I20260812 06:17:13.957698 30406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff: No bootstrap required, opened a new log
I20260812 06:17:13.957722 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:13.957949 707 external_mini_cluster.cc:1428] Setting key 932dac7e80f58e8bf8c8eb1b779895ae
I20260812 06:17:13.959758 30406 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48c7b20b284f47439e8fdf00d8ce68ff" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42149 } }
I20260812 06:17:13.959923 30406 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:13.959969 30406 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48c7b20b284f47439e8fdf00d8ce68ff, State: Initialized, Role: FOLLOWER
I20260812 06:17:13.960140 30406 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48c7b20b284f47439e8fdf00d8ce68ff" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42149 } }
I20260812 06:17:13.960237 30406 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:13.960278 30406 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:13.960358 30406 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:13.960933 30406 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48c7b20b284f47439e8fdf00d8ce68ff" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42149 } }
I20260812 06:17:13.961051 30406 leader_election.cc:302] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48c7b20b284f47439e8fdf00d8ce68ff; no voters:
I20260812 06:17:13.961231 30406 leader_election.cc:288] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:13.961278 30411 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:13.961445 30411 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [term 1 LEADER]: Becoming Leader. State: Replica: 48c7b20b284f47439e8fdf00d8ce68ff, State: Running, Role: LEADER
I20260812 06:17:13.961542 30406 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:13.961587 30411 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48c7b20b284f47439e8fdf00d8ce68ff" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42149 } }
I20260812 06:17:13.962204 30411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48c7b20b284f47439e8fdf00d8ce68ff. Latest consensus state: current_term: 1 leader_uuid: "48c7b20b284f47439e8fdf00d8ce68ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48c7b20b284f47439e8fdf00d8ce68ff" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42149 } } }
I20260812 06:17:13.962373 30411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:13.962632 30427 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:13.963454 30427 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:13.963665 30415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48c7b20b284f47439e8fdf00d8ce68ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48c7b20b284f47439e8fdf00d8ce68ff" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42149 } } }
I20260812 06:17:13.963847 30415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:13.965258 30427 catalog_manager.cc:1347] Generated new cluster ID: 6e29881a63444b359cac54435daf26c0
I20260812 06:17:13.965315 30427 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:13.968034 30410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:13.958588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43566 (local address 127.0.176.254:42149)
0812 06:17:13.958834 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:13.958841 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:13.958867 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:17:13.959774 (+ 907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:13.959781 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:13.959863 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:13.960033 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:13.960299 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.962057 (+ 1758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.963295 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:13.963926 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:13.964054 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:13.964799 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:13.964803 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:13.964803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:13.965026 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:13.965083 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:13.965099 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:13.965190 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:13.967725 (+ 2535us) server_negotiation.cc:299] Negotiation successful
0812 06:17:13.967819 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":81,"threads_started":1}
I20260812 06:17:13.971993 30427 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:13.972608 30427 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:13.983000 30427 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff: Generated new TSK 0
I20260812 06:17:13.983227 30427 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:13.990419 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42149
--builtin_ntp_servers=127.0.176.212:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:17:14.083238 30442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:14.083571 30442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:14.083618 30442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:14.084848 30442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:14.084928 30442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:14.084971 30442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:17:14.086396 30442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:14.086689 30442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:14.087038 30442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:14.092370 30456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:14.092483 30453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:14.092375 30452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:14.093005 30442 server_base.cc:1034] running on GCE node
I20260812 06:17:14.093232 30442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:14.093508 30442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:14.094686 30442 hybrid_clock.cc:648] HybridClock initialized: now 1786515434094673 us; error 29 us; skew 500 ppm
I20260812 06:17:14.096309 30442 webserver.cc:460] Webserver started at http://127.0.176.193:35341/ using document root <none> and password file <none>
I20260812 06:17:14.096624 30442 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:14.096690 30442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:14.096838 30442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:14.098412 30442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "81ee04d3b32e47b3baf75483d5b38a73"
format_stamp: "Formatted at 2026-08-12 06:17:14 on dist-test-slave-gw5c"
server_key: "145ea7935a81b56c7478043e3583adac"
server_key_iv: "d6cf46b432d79c8185a7b0e2c42365be"
server_key_version: "encryptionkey@0"
I20260812 06:17:14.098933 30442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "81ee04d3b32e47b3baf75483d5b38a73"
format_stamp: "Formatted at 2026-08-12 06:17:14 on dist-test-slave-gw5c"
server_key: "145ea7935a81b56c7478043e3583adac"
server_key_iv: "d6cf46b432d79c8185a7b0e2c42365be"
server_key_version: "encryptionkey@0"
I20260812 06:17:14.101281 30442 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260812 06:17:14.102654 30468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:14.102910 30442 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:14.103042 30442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "81ee04d3b32e47b3baf75483d5b38a73"
format_stamp: "Formatted at 2026-08-12 06:17:14 on dist-test-slave-gw5c"
server_key: "145ea7935a81b56c7478043e3583adac"
server_key_iv: "d6cf46b432d79c8185a7b0e2c42365be"
server_key_version: "encryptionkey@0"
I20260812 06:17:14.103132 30442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:14.133169 30442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:14.133560 30442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:14.133714 30442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:14.134022 30442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:14.134403 30442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:14.134440 30442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:14.134487 30442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:14.134516 30442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:14.140972 30442 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:36357
I20260812 06:17:14.141032 30651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:36357 every 8 connection(s)
I20260812 06:17:14.141402 30442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:17:14.147212 30410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.142556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:39367 (local address 127.0.176.254:42149)
0812 06:17:14.142630 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:14.142632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:14.142924 (+ 292us) server_negotiation.cc:407] Connection header received
0812 06:17:14.143467 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:14.143468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:14.143482 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:14.143544 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:14.144356 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.144859 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.145890 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.146093 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.146151 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.146968 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:14.146969 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:14.146969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:14.146977 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:14.146992 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:14.146996 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:14.147041 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:14.147126 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 06:17:14.147150 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:17:14.147444 30655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.142538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42149 (local address 127.0.176.193:39367)
0812 06:17:14.142783 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:14.142822 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:14.143313 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:14.143676 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:14.143682 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:14.143693 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:14.144233 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.144237 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.144979 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.144981 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.145794 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.145797 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.146179 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.146180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.146297 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.146834 (+ 537us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:17:14.146834 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:14.146864 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:17:14.146887 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:14.147052 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:14.147056 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:14.147059 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:17:14.147111 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 06:17:14.147191 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":131,"threads_started":1}
I20260812 06:17:14.147993 30652 heartbeater.cc:347] Connected to a master server at 127.0.176.254:42149
I20260812 06:17:14.148115 30652 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:14.148344 30652 heartbeater.cc:511] Master 127.0.176.254:42149 requested a full tablet report, sending...
I20260812 06:17:14.148387 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 30442
I20260812 06:17:14.148475 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:17:14.148693 707 external_mini_cluster.cc:1428] Setting key 3e748db970ab9f465e522e141fa98786
I20260812 06:17:14.148967 30349 ts_manager.cc:194] Registered new tserver with Master: 81ee04d3b32e47b3baf75483d5b38a73 (127.0.176.193:36357)
I20260812 06:17:14.149760 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42149
--builtin_ntp_servers=127.0.176.212:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 06:17:14.149919 30349 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.176.193:39367
W20260812 06:17:14.234360 30656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:14.234581 30656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:14.234606 30656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:14.235838 30656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:14.235877 30656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:14.235903 30656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:17:14.237232 30656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:14.237444 30656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:14.237723 30656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:14.242937 30661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:14.242949 30665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:14.242971 30662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:14.243374 30656 server_base.cc:1034] running on GCE node
I20260812 06:17:14.243618 30656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:14.243837 30656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:14.244989 30656 hybrid_clock.cc:648] HybridClock initialized: now 1786515434244976 us; error 29 us; skew 500 ppm
I20260812 06:17:14.246696 30656 webserver.cc:460] Webserver started at http://127.0.176.194:44495/ using document root <none> and password file <none>
I20260812 06:17:14.247080 30656 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:14.247133 30656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:14.247274 30656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:14.248512 30656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "b5a6d88f2066462ab3c480fabb762e5b"
format_stamp: "Formatted at 2026-08-12 06:17:14 on dist-test-slave-gw5c"
server_key: "83502ef8674fd79fd70b5534e5c4fde3"
server_key_iv: "5871df9f0cc3295f79b3297c981fe74f"
server_key_version: "encryptionkey@0"
I20260812 06:17:14.248908 30656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "b5a6d88f2066462ab3c480fabb762e5b"
format_stamp: "Formatted at 2026-08-12 06:17:14 on dist-test-slave-gw5c"
server_key: "83502ef8674fd79fd70b5534e5c4fde3"
server_key_iv: "5871df9f0cc3295f79b3297c981fe74f"
server_key_version: "encryptionkey@0"
I20260812 06:17:14.250375 30656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:17:14.251303 30674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:14.251585 30656 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:14.251718 30656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "b5a6d88f2066462ab3c480fabb762e5b"
format_stamp: "Formatted at 2026-08-12 06:17:14 on dist-test-slave-gw5c"
server_key: "83502ef8674fd79fd70b5534e5c4fde3"
server_key_iv: "5871df9f0cc3295f79b3297c981fe74f"
server_key_version: "encryptionkey@0"
I20260812 06:17:14.251811 30656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:14.261253 30656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:14.261619 30656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:14.261827 30656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:14.262082 30656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:14.262444 30656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:14.262494 30656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:14.262519 30656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:14.262567 30656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:14.268653 30656 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:44497
I20260812 06:17:14.268738 30858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:44497 every 8 connection(s)
I20260812 06:17:14.269091 30656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:17:14.274642 30410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.270074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:37205 (local address 127.0.176.254:42149)
0812 06:17:14.270195 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:14.270197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:14.270379 (+ 182us) server_negotiation.cc:407] Connection header received
0812 06:17:14.270882 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:14.270884 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:14.270895 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:14.270957 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:14.271752 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.272247 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.273231 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.273437 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.273496 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.274422 (+ 926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:14.274423 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:14.274423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:14.274427 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:14.274438 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:14.274442 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:14.274484 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:14.274544 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 06:17:14.274568 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 06:17:14.274880 30862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.269991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42149 (local address 127.0.176.194:37205)
0812 06:17:14.270210 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:14.270247 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:14.270765 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:14.271025 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:14.271028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:14.271036 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:14.271658 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.271664 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.272349 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.272350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.273145 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.273147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.273529 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.273530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.273648 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.274282 (+ 634us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:17:14.274283 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:14.274320 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:17:14.274347 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:14.274485 (+ 138us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:14.274487 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:14.274490 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:17:14.274536 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 06:17:14.274616 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":81,"threads_started":1}
I20260812 06:17:14.275432 30860 heartbeater.cc:347] Connected to a master server at 127.0.176.254:42149
I20260812 06:17:14.275557 30860 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:14.275754 30860 heartbeater.cc:511] Master 127.0.176.254:42149 requested a full tablet report, sending...
I20260812 06:17:14.276026 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 30656
I20260812 06:17:14.276144 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:17:14.276190 30349 ts_manager.cc:194] Registered new tserver with Master: b5a6d88f2066462ab3c480fabb762e5b (127.0.176.194:44497)
I20260812 06:17:14.276383 707 external_mini_cluster.cc:1428] Setting key a97a04d24d65fdb5fd217f1ecfeed7c9
I20260812 06:17:14.276685 30349 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.176.194:37205
I20260812 06:17:14.277362 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42149
--builtin_ntp_servers=127.0.176.212:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:17:14.361647 30864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:14.361985 30864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:14.362027 30864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:14.363446 30864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:14.363492 30864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:14.363520 30864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:17:14.364882 30864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:14.365098 30864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:14.365382 30864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:14.370574 30872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:14.370612 30874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:14.370658 30877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:14.371061 30864 server_base.cc:1034] running on GCE node
I20260812 06:17:14.371310 30864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:14.371613 30864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:14.372784 30864 hybrid_clock.cc:648] HybridClock initialized: now 1786515434372771 us; error 31 us; skew 500 ppm
I20260812 06:17:14.374128 30864 webserver.cc:460] Webserver started at http://127.0.176.195:42987/ using document root <none> and password file <none>
I20260812 06:17:14.374410 30864 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:14.374482 30864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:14.374639 30864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:14.375844 30864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "8257e14a7b9842659c23f69abe814dba"
format_stamp: "Formatted at 2026-08-12 06:17:14 on dist-test-slave-gw5c"
server_key: "6002d3c13dc11cfbd32ef9f80c783cd8"
server_key_iv: "2ba1d5504f6eeca34ea8d20fde4da4b0"
server_key_version: "encryptionkey@0"
I20260812 06:17:14.376226 30864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "8257e14a7b9842659c23f69abe814dba"
format_stamp: "Formatted at 2026-08-12 06:17:14 on dist-test-slave-gw5c"
server_key: "6002d3c13dc11cfbd32ef9f80c783cd8"
server_key_iv: "2ba1d5504f6eeca34ea8d20fde4da4b0"
server_key_version: "encryptionkey@0"
I20260812 06:17:14.377605 30864 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:17:14.378414 30890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:14.378649 30864 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:14.378759 30864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "8257e14a7b9842659c23f69abe814dba"
format_stamp: "Formatted at 2026-08-12 06:17:14 on dist-test-slave-gw5c"
server_key: "6002d3c13dc11cfbd32ef9f80c783cd8"
server_key_iv: "2ba1d5504f6eeca34ea8d20fde4da4b0"
server_key_version: "encryptionkey@0"
I20260812 06:17:14.378836 30864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:14.395824 30864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:14.396212 30864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:14.396405 30864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:14.396672 30864 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:14.397059 30864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:14.397123 30864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:14.397166 30864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:14.397210 30864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:14.403729 30864 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:37999
I20260812 06:17:14.403831 31066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:37999 every 8 connection(s)
I20260812 06:17:14.404192 30864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:17:14.410308 30410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.405042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:38965 (local address 127.0.176.254:42149)
0812 06:17:14.405104 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:14.405106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:14.405361 (+ 255us) server_negotiation.cc:407] Connection header received
0812 06:17:14.406056 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:14.406057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:14.406068 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:14.406126 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:14.406879 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.407480 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.408685 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.408878 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.408939 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.409994 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:14.409995 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:14.409996 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:14.410002 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:14.410018 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:14.410022 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:14.410081 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:14.410206 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 06:17:14.410238 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:17:14.410483 31069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.404988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42149 (local address 127.0.176.195:38965)
0812 06:17:14.405206 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:14.405249 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:14.405953 (+ 704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:14.406181 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:14.406185 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:14.406194 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:14.406732 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.406761 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.407618 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.407619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.408547 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.408550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.409004 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.409004 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.409128 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.409814 (+ 686us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:17:14.409815 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:14.409847 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:17:14.409872 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:14.410097 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:14.410101 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:14.410104 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:17:14.410162 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:17:14.410254 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":109,"threads_started":1}
I20260812 06:17:14.411062 31067 heartbeater.cc:347] Connected to a master server at 127.0.176.254:42149
I20260812 06:17:14.411163 31067 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:14.411329 31067 heartbeater.cc:511] Master 127.0.176.254:42149 requested a full tablet report, sending...
I20260812 06:17:14.411855 30348 ts_manager.cc:194] Registered new tserver with Master: 8257e14a7b9842659c23f69abe814dba (127.0.176.195:37999)
I20260812 06:17:14.412246 30348 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.176.195:38965
I20260812 06:17:14.413579 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 30864
I20260812 06:17:14.413666 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:17:14.413834 707 external_mini_cluster.cc:1428] Setting key 4a28f9eb17eb36d1f904d3d2265216f2
I20260812 06:17:14.414554 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:17:14.419536 30410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.416070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43956 (local address 127.0.176.254:42149)
0812 06:17:14.416125 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:14.416127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:14.416187 (+ 60us) server_negotiation.cc:407] Connection header received
0812 06:17:14.416255 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:14.416256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:14.416267 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:14.416307 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:14.416436 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.417102 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.418056 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.418267 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.418339 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.419185 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:14.419187 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:14.419187 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:14.419195 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:14.419208 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:14.419212 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:14.419264 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:14.419427 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 06:17:14.419464 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:17:14.421357 30348 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43956:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:17:14.423043 30348 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:17:14.430027 31083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.425558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45172 (local address 127.0.176.194:44497)
0812 06:17:14.426190 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:14.426194 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:14.426204 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:17:14.426245 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:14.426247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:14.426262 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:14.426512 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:14.426578 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.427776 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.429007 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.429516 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.429612 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.429718 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:14.429884 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 06:17:14.429929 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":86,"threads_started":1}
I20260812 06:17:14.430256 31085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.425668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36798 (local address 127.0.176.193:36357)
0812 06:17:14.425883 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:14.425888 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:14.425903 (+ 15us) server_negotiation.cc:407] Connection header received
0812 06:17:14.425949 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:14.425951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:14.425967 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:14.426057 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:14.426396 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.427236 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.428774 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.429551 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.429686 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.429787 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:14.430128 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 06:17:14.430174 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":101,"threads_started":1}
I20260812 06:17:14.430263 31086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.425767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39250 (local address 127.0.176.195:37999)
0812 06:17:14.425963 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:14.425967 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:14.425976 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:17:14.426013 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:14.426015 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:14.426030 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:14.426424 (+ 394us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:14.426492 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.427759 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.428970 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.429744 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.430031 (+ 287us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.430122 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:14.430147 (+ 25us) server_negotiation.cc:299] Negotiation successful
0812 06:17:14.430181 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":100,"threads_started":1}
I20260812 06:17:14.430377 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.425381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:37999 (local address 127.0.0.1:39250)
0812 06:17:14.425684 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:14.425696 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:14.425755 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:14.426223 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:14.426224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:14.426225 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:14.426291 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.426294 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.427891 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.427892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.428868 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.428871 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.429833 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.429833 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.429902 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.429906 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:14.429938 (+ 32us) client_negotiation.cc:240] Negotiation successful
0812 06:17:14.429984 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":5,"thread_start_us":94,"threads_started":1}
I20260812 06:17:14.430600 31082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.425377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:44497 (local address 127.0.0.1:45172)
0812 06:17:14.425597 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:14.425640 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:14.425711 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:14.426365 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:14.426366 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:14.426368 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:14.426431 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.426433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.427874 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.427875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.428918 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.428921 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.429611 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.429612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.429735 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.429753 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 06:17:14.429865 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 06:17:14.429929 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":29,"thread_start_us":124,"threads_started":1}
I20260812 06:17:14.430086 31081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.425395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:36357 (local address 127.0.0.1:36798)
0812 06:17:14.425832 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:14.425842 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:14.425881 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:14.426204 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:14.426207 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:14.426209 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:14.426291 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.426294 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.427324 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.427326 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.428674 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.428677 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.429829 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.429830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.429902 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.429907 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:17:14.429956 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 06:17:14.429984 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"mutex_wait_us":8,"thread_start_us":115,"threads_started":1}
I20260812 06:17:14.431277 30969 tablet_service.cc:1467] Processing CreateTablet for tablet 4186f30b89124a53bcdb45d7144e0811 (DEFAULT_TABLE table=test-table [id=561ba9b4f81c4c6b8991ad92acc2e36d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:14.431324 30543 tablet_service.cc:1467] Processing CreateTablet for tablet 4186f30b89124a53bcdb45d7144e0811 (DEFAULT_TABLE table=test-table [id=561ba9b4f81c4c6b8991ad92acc2e36d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:14.431370 30749 tablet_service.cc:1467] Processing CreateTablet for tablet 4186f30b89124a53bcdb45d7144e0811 (DEFAULT_TABLE table=test-table [id=561ba9b4f81c4c6b8991ad92acc2e36d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:14.431743 30543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4186f30b89124a53bcdb45d7144e0811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:14.431740 30749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4186f30b89124a53bcdb45d7144e0811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:14.431740 30969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4186f30b89124a53bcdb45d7144e0811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:14.434670 31088 tablet_bootstrap.cc:492] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73: Bootstrap starting.
I20260812 06:17:14.435180 31091 tablet_bootstrap.cc:492] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba: Bootstrap starting.
I20260812 06:17:14.435526 31092 tablet_bootstrap.cc:492] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b: Bootstrap starting.
I20260812 06:17:14.435798 31088 tablet_bootstrap.cc:654] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:14.435843 31091 tablet_bootstrap.cc:654] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:14.436136 31092 tablet_bootstrap.cc:654] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:14.436177 31088 log.cc:824] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:14.436177 31091 log.cc:824] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:14.436527 31092 log.cc:824] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:14.437052 31091 tablet_bootstrap.cc:492] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba: No bootstrap required, opened a new log
I20260812 06:17:14.437134 31091 ts_tablet_manager.cc:1397] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:17:14.437256 31092 tablet_bootstrap.cc:492] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b: No bootstrap required, opened a new log
I20260812 06:17:14.437359 31092 ts_tablet_manager.cc:1397] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:17:14.437426 31088 tablet_bootstrap.cc:492] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73: No bootstrap required, opened a new log
I20260812 06:17:14.437500 31088 ts_tablet_manager.cc:1397] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:17:14.439220 31092 raft_consensus.cc:348] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8257e14a7b9842659c23f69abe814dba" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37999 } } peers { permanent_uuid: "b5a6d88f2066462ab3c480fabb762e5b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 44497 } } peers { permanent_uuid: "81ee04d3b32e47b3baf75483d5b38a73" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36357 } }
I20260812 06:17:14.439473 31092 raft_consensus.cc:374] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:14.439522 31092 raft_consensus.cc:729] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5a6d88f2066462ab3c480fabb762e5b, State: Initialized, Role: FOLLOWER
I20260812 06:17:14.439638 31092 consensus_queue.cc:260] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8257e14a7b9842659c23f69abe814dba" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37999 } } peers { permanent_uuid: "b5a6d88f2066462ab3c480fabb762e5b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 44497 } } peers { permanent_uuid: "81ee04d3b32e47b3baf75483d5b38a73" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36357 } }
I20260812 06:17:14.439961 30860 heartbeater.cc:503] Master 127.0.176.254:42149 was elected leader, sending a full tablet report...
I20260812 06:17:14.439961 31092 ts_tablet_manager.cc:1428] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:17:14.439962 31091 raft_consensus.cc:348] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8257e14a7b9842659c23f69abe814dba" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37999 } } peers { permanent_uuid: "b5a6d88f2066462ab3c480fabb762e5b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 44497 } } peers { permanent_uuid: "81ee04d3b32e47b3baf75483d5b38a73" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36357 } }
I20260812 06:17:14.440115 31091 raft_consensus.cc:374] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:14.440147 31091 raft_consensus.cc:729] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8257e14a7b9842659c23f69abe814dba, State: Initialized, Role: FOLLOWER
I20260812 06:17:14.440285 31091 consensus_queue.cc:260] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8257e14a7b9842659c23f69abe814dba" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37999 } } peers { permanent_uuid: "b5a6d88f2066462ab3c480fabb762e5b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 44497 } } peers { permanent_uuid: "81ee04d3b32e47b3baf75483d5b38a73" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36357 } }
I20260812 06:17:14.440220 31088 raft_consensus.cc:348] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8257e14a7b9842659c23f69abe814dba" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37999 } } peers { permanent_uuid: "b5a6d88f2066462ab3c480fabb762e5b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 44497 } } peers { permanent_uuid: "81ee04d3b32e47b3baf75483d5b38a73" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36357 } }
I20260812 06:17:14.440367 31088 raft_consensus.cc:374] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:14.440412 31088 raft_consensus.cc:729] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81ee04d3b32e47b3baf75483d5b38a73, State: Initialized, Role: FOLLOWER
I20260812 06:17:14.440563 31091 ts_tablet_manager.cc:1428] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 06:17:14.440536 31088 consensus_queue.cc:260] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8257e14a7b9842659c23f69abe814dba" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37999 } } peers { permanent_uuid: "b5a6d88f2066462ab3c480fabb762e5b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 44497 } } peers { permanent_uuid: "81ee04d3b32e47b3baf75483d5b38a73" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36357 } }
I20260812 06:17:14.440706 31067 heartbeater.cc:503] Master 127.0.176.254:42149 was elected leader, sending a full tablet report...
I20260812 06:17:14.440793 31088 ts_tablet_manager.cc:1428] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260812 06:17:14.440912 30652 heartbeater.cc:503] Master 127.0.176.254:42149 was elected leader, sending a full tablet report...
I20260812 06:17:14.454321 31099 raft_consensus.cc:482] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:17:14.454496 31099 raft_consensus.cc:504] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8257e14a7b9842659c23f69abe814dba" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37999 } } peers { permanent_uuid: "b5a6d88f2066462ab3c480fabb762e5b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 44497 } } peers { permanent_uuid: "81ee04d3b32e47b3baf75483d5b38a73" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36357 } }
I20260812 06:17:14.454916 31099 leader_election.cc:288] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8257e14a7b9842659c23f69abe814dba (127.0.176.195:37999), 81ee04d3b32e47b3baf75483d5b38a73 (127.0.176.193:36357)
I20260812 06:17:14.457798 31086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.455132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:50793 (local address 127.0.176.195:37999)
0812 06:17:14.455201 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:14.455203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:14.455216 (+ 13us) server_negotiation.cc:407] Connection header received
0812 06:17:14.455251 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:14.455251 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:14.455261 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:14.455325 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:14.455513 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.456086 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.457040 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.457438 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.457512 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.457521 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:14.457680 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 06:17:14.457731 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 06:17:14.457788 30862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.455061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:37999 (local address 127.0.176.194:50793)
0812 06:17:14.455124 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:14.455136 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:14.455178 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:14.455342 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:14.455344 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:14.455346 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:14.455438 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.455440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.456182 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.456183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.456944 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.456946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.457527 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.457528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.457604 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.457608 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:14.457664 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 06:17:14.457699 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 06:17:14.457864 31085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.455161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:54477 (local address 127.0.176.193:36357)
0812 06:17:14.455206 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:14.455208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:14.455464 (+ 256us) server_negotiation.cc:407] Connection header received
0812 06:17:14.455501 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:14.455502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:14.455516 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:14.455567 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:14.455714 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.456181 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.457096 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.457509 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.457579 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.457587 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:14.457750 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 06:17:14.457792 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:17:14.457901 31103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.455103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:36357 (local address 127.0.176.194:54477)
0812 06:17:14.455314 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:14.455324 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:14.455381 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:14.455587 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:14.455588 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:14.455590 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:14.455658 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.455659 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.456250 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.456251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.456994 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:14.456996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.457592 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.457593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:14.457674 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.457678 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:14.457734 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 06:17:14.457770 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":134,"threads_started":1}
I20260812 06:17:14.458310 30573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4186f30b89124a53bcdb45d7144e0811" candidate_uuid: "b5a6d88f2066462ab3c480fabb762e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81ee04d3b32e47b3baf75483d5b38a73" is_pre_election: true
I20260812 06:17:14.458367 30998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4186f30b89124a53bcdb45d7144e0811" candidate_uuid: "b5a6d88f2066462ab3c480fabb762e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8257e14a7b9842659c23f69abe814dba" is_pre_election: true
I20260812 06:17:14.458490 30573 raft_consensus.cc:2454] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5a6d88f2066462ab3c480fabb762e5b in term 0.
I20260812 06:17:14.458511 30998 raft_consensus.cc:2454] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5a6d88f2066462ab3c480fabb762e5b in term 0.
I20260812 06:17:14.458778 30680 leader_election.cc:302] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8257e14a7b9842659c23f69abe814dba, b5a6d88f2066462ab3c480fabb762e5b; no voters:
I20260812 06:17:14.458956 31099 raft_consensus.cc:2781] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:17:14.459043 31099 raft_consensus.cc:482] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:17:14.459061 31099 raft_consensus.cc:3037] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:14.459884 31099 raft_consensus.cc:504] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8257e14a7b9842659c23f69abe814dba" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37999 } } peers { permanent_uuid: "b5a6d88f2066462ab3c480fabb762e5b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 44497 } } peers { permanent_uuid: "81ee04d3b32e47b3baf75483d5b38a73" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36357 } }
I20260812 06:17:14.460031 31099 leader_election.cc:288] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [CANDIDATE]: Term 1 election: Requested vote from peers 8257e14a7b9842659c23f69abe814dba (127.0.176.195:37999), 81ee04d3b32e47b3baf75483d5b38a73 (127.0.176.193:36357)
I20260812 06:17:14.460210 30573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4186f30b89124a53bcdb45d7144e0811" candidate_uuid: "b5a6d88f2066462ab3c480fabb762e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81ee04d3b32e47b3baf75483d5b38a73"
I20260812 06:17:14.460227 30998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4186f30b89124a53bcdb45d7144e0811" candidate_uuid: "b5a6d88f2066462ab3c480fabb762e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8257e14a7b9842659c23f69abe814dba"
I20260812 06:17:14.460299 30573 raft_consensus.cc:3037] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:14.460309 30998 raft_consensus.cc:3037] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:14.461228 30573 raft_consensus.cc:2454] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5a6d88f2066462ab3c480fabb762e5b in term 1.
I20260812 06:17:14.461228 30998 raft_consensus.cc:2454] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5a6d88f2066462ab3c480fabb762e5b in term 1.
I20260812 06:17:14.461453 30675 leader_election.cc:302] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 81ee04d3b32e47b3baf75483d5b38a73, 8257e14a7b9842659c23f69abe814dba, b5a6d88f2066462ab3c480fabb762e5b; no voters:
I20260812 06:17:14.461546 31099 raft_consensus.cc:2781] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:14.461719 31099 raft_consensus.cc:686] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [term 1 LEADER]: Becoming Leader. State: Replica: b5a6d88f2066462ab3c480fabb762e5b, State: Running, Role: LEADER
I20260812 06:17:14.461822 31099 consensus_queue.cc:237] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8257e14a7b9842659c23f69abe814dba" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37999 } } peers { permanent_uuid: "b5a6d88f2066462ab3c480fabb762e5b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 44497 } } peers { permanent_uuid: "81ee04d3b32e47b3baf75483d5b38a73" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36357 } }
I20260812 06:17:14.462765 30345 catalog_manager.cc:5495] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b reported cstate change: term changed from 0 to 1, leader changed from <none> to b5a6d88f2066462ab3c480fabb762e5b (127.0.176.194). New cstate: current_term: 1 leader_uuid: "b5a6d88f2066462ab3c480fabb762e5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8257e14a7b9842659c23f69abe814dba" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5a6d88f2066462ab3c480fabb762e5b" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81ee04d3b32e47b3baf75483d5b38a73" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36357 } health_report { overall_health: UNKNOWN } } }
I20260812 06:17:14.475907 31083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.473528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45188 (local address 127.0.176.194:44497)
0812 06:17:14.473592 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:14.473594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:14.473610 (+ 16us) server_negotiation.cc:407] Connection header received
0812 06:17:14.473650 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:14.473651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:14.473670 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:14.473732 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:14.473838 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.474308 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.475052 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:14.475239 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:14.475295 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:14.475530 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:14.475641 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:14.475748 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:14.475766 (+ 18us) server_negotiation.cc:299] Negotiation successful
0812 06:17:14.475786 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:17:14.477821 30573 raft_consensus.cc:1261] T 4186f30b89124a53bcdb45d7144e0811 P 81ee04d3b32e47b3baf75483d5b38a73 [term 1 FOLLOWER]: Refusing update from remote peer b5a6d88f2066462ab3c480fabb762e5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:14.477823 30998 raft_consensus.cc:1261] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba [term 1 FOLLOWER]: Refusing update from remote peer b5a6d88f2066462ab3c480fabb762e5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:14.478220 31104 consensus_queue.cc:1035] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81ee04d3b32e47b3baf75483d5b38a73" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 36357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:14.478354 31099 consensus_queue.cc:1035] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8257e14a7b9842659c23f69abe814dba" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:14.480600 31108 mvcc.cc:205] Tried to move back new op lower bound from 7317567219618299904 to 7317567219556515840. Current Snapshot: MvccSnapshot[applied={T|T < 7317567219618299904}]
I20260812 06:17:14.480943 31109 mvcc.cc:205] Tried to move back new op lower bound from 7317567219618299904 to 7317567219556515840. Current Snapshot: MvccSnapshot[applied={T|T < 7317567219618299904}]
I20260812 06:17:14.481215 31111 mvcc.cc:205] Tried to move back new op lower bound from 7317567219618299904 to 7317567219556515840. Current Snapshot: MvccSnapshot[applied={T|T < 7317567219618299904}]
I20260812 06:17:14.483572 30349 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:17:14.483662 30349 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:17:14.484457 30349 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 48c7b20b284f47439e8fdf00d8ce68ff: Sending DeleteTablet for 3 replicas of tablet 4186f30b89124a53bcdb45d7144e0811
I20260812 06:17:14.484823 30543 tablet_service.cc:1514] Processing DeleteTablet for tablet 4186f30b89124a53bcdb45d7144e0811 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:14 UTC) from {username='slave'} at 127.0.0.1:36798
I20260812 06:17:14.484861 30969 tablet_service.cc:1514] Processing DeleteTablet for tablet 4186f30b89124a53bcdb45d7144e0811 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:14 UTC) from {username='slave'} at 127.0.0.1:39250
I20260812 06:17:14.484861 30749 tablet_service.cc:1514] Processing DeleteTablet for tablet 4186f30b89124a53bcdb45d7144e0811 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:14 UTC) from {username='slave'} at 127.0.0.1:45172
I20260812 06:17:14.485203 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 30442
I20260812 06:17:14.495599 31127 tablet_replica.cc:330] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b: stopping tablet replica
I20260812 06:17:14.495777 31127 raft_consensus.cc:2229] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:17:14.495955 31127 raft_consensus.cc:2258] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:14.495983 31130 tablet_replica.cc:330] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba: stopping tablet replica
I20260812 06:17:14.496203 31130 raft_consensus.cc:2229] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:17:14.496372 31130 raft_consensus.cc:2258] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:14.498028 31127 ts_tablet_manager.cc:1905] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:17:14.500066 31130 ts_tablet_manager.cc:1905] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:17:14.500316 31127 ts_tablet_manager.cc:1918] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:17:14.500414 31127 log.cc:1196] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/4186f30b89124a53bcdb45d7144e0811
I20260812 06:17:14.500711 31127 ts_tablet_manager.cc:1939] T 4186f30b89124a53bcdb45d7144e0811 P b5a6d88f2066462ab3c480fabb762e5b: Deleting consensus metadata
I20260812 06:17:14.501210 30323 catalog_manager.cc:4841] TS b5a6d88f2066462ab3c480fabb762e5b (127.0.176.194:44497): tablet 4186f30b89124a53bcdb45d7144e0811 (table test-table [id=561ba9b4f81c4c6b8991ad92acc2e36d]) successfully deleted
I20260812 06:17:14.501797 31130 ts_tablet_manager.cc:1918] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:17:14.501919 31130 log.cc:1196] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/4186f30b89124a53bcdb45d7144e0811
I20260812 06:17:14.502163 31130 ts_tablet_manager.cc:1939] T 4186f30b89124a53bcdb45d7144e0811 P 8257e14a7b9842659c23f69abe814dba: Deleting consensus metadata
I20260812 06:17:14.502645 30326 catalog_manager.cc:4841] TS 8257e14a7b9842659c23f69abe814dba (127.0.176.195:37999): tablet 4186f30b89124a53bcdb45d7144e0811 (table test-table [id=561ba9b4f81c4c6b8991ad92acc2e36d]) successfully deleted
W20260812 06:17:14.505172 30322 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:36357 (error 108)
I20260812 06:17:14.505373 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 30656
I20260812 06:17:14.521087 31081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:14.520849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:36357 (local address 127.0.0.1:36806)
0812 06:17:14.520944 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:14.521030 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:36357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260812 06:17:14.521306 30322 catalog_manager.cc:4584] TS 81ee04d3b32e47b3baf75483d5b38a73 (127.0.176.193:36357): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4186f30b89124a53bcdb45d7144e0811: Network error: Client connection negotiation failed: client connection to 127.0.176.193:36357: connect: Connection refused (error 111)
I20260812 06:17:14.525300 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 30864
I20260812 06:17:14.536674 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 30294
2026-08-12T06:17:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (752 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:14 dist-test-slave-gw5c krb5kdc[31135](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:14 dist-test-slave-gw5c krb5kdc[31135](info): set up 2 sockets
Aug 12 06:17:14 dist-test-slave-gw5c krb5kdc[31135](info): commencing operation
krb5kdc: starting...
W20260812 06:17:15.829452 707 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:15 dist-test-slave-gw5c krb5kdc[31135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:17:15.962222 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42325
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:42325
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:16.056012 31159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:16.056483 31159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:16.056577 31159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:16.057964 31159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:16.058048 31159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:16.058076 31159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:16.058109 31159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:16.058137 31159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:16.059922 31159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:42325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:16.060238 31159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:16.060500 31159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:16.065770 31164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:16.065765 31165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:16.065765 31170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:16.066008 31159 server_base.cc:1034] running on GCE node
I20260812 06:17:16.066278 31159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:16.066603 31159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:16.067781 31159 hybrid_clock.cc:648] HybridClock initialized: now 1786515436067771 us; error 49 us; skew 500 ppm
Aug 12 06:17:16 dist-test-slave-gw5c krb5kdc[31135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515436, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:16.070570 31159 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:17:16.071105 31159 webserver.cc:460] Webserver started at http://127.0.176.254:40735/ using document root <none> and password file <none>
I20260812 06:17:16.071378 31159 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:16.071511 31159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:16.071676 31159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:16.072834 31159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "02c6b264b90e45de901042c41f464a47"
format_stamp: "Formatted at 2026-08-12 06:17:16 on dist-test-slave-gw5c"
server_key: "cdf4d8fda2a84cfaa86944c479465f14"
server_key_iv: "6457f2edf0d7ae67cc465bdbbfca3b57"
server_key_version: "encryptionkey@0"
I20260812 06:17:16.073225 31159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "02c6b264b90e45de901042c41f464a47"
format_stamp: "Formatted at 2026-08-12 06:17:16 on dist-test-slave-gw5c"
server_key: "cdf4d8fda2a84cfaa86944c479465f14"
server_key_iv: "6457f2edf0d7ae67cc465bdbbfca3b57"
server_key_version: "encryptionkey@0"
I20260812 06:17:16.074672 31159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:17:16.075495 31184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:16.075685 31159 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:16.075794 31159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "02c6b264b90e45de901042c41f464a47"
format_stamp: "Formatted at 2026-08-12 06:17:16 on dist-test-slave-gw5c"
server_key: "cdf4d8fda2a84cfaa86944c479465f14"
server_key_iv: "6457f2edf0d7ae67cc465bdbbfca3b57"
server_key_version: "encryptionkey@0"
I20260812 06:17:16.075881 31159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:16.085688 31159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:16.088081 31159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:16.088274 31159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:16.093058 31159 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:42325
I20260812 06:17:16.093092 31255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:42325 every 8 connection(s)
I20260812 06:17:16.093503 31159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:16.094465 31256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:16.097054 31256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47: Bootstrap starting.
I20260812 06:17:16.097738 31256 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:16.098067 31256 log.cc:824] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:16.098737 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 31159
I20260812 06:17:16.098867 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:16.099128 707 external_mini_cluster.cc:1428] Setting key e7def2d7888266d082436eee536c753e
I20260812 06:17:16.099305 31256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47: No bootstrap required, opened a new log
I20260812 06:17:16.101280 31256 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02c6b264b90e45de901042c41f464a47" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42325 } }
I20260812 06:17:16.101497 31256 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:16.101541 31256 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02c6b264b90e45de901042c41f464a47, State: Initialized, Role: FOLLOWER
I20260812 06:17:16.101701 31256 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02c6b264b90e45de901042c41f464a47" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42325 } }
I20260812 06:17:16.101807 31256 raft_consensus.cc:388] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:16.101843 31256 raft_consensus.cc:482] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:16.101897 31256 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:16.102665 31256 raft_consensus.cc:504] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02c6b264b90e45de901042c41f464a47" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42325 } }
I20260812 06:17:16.102839 31256 leader_election.cc:302] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 02c6b264b90e45de901042c41f464a47; no voters:
I20260812 06:17:16.103061 31256 leader_election.cc:288] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:16.103097 31266 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:16.103228 31266 raft_consensus.cc:686] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [term 1 LEADER]: Becoming Leader. State: Replica: 02c6b264b90e45de901042c41f464a47, State: Running, Role: LEADER
I20260812 06:17:16.103411 31256 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:16.103439 31266 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02c6b264b90e45de901042c41f464a47" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42325 } }
I20260812 06:17:16.103826 31266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02c6b264b90e45de901042c41f464a47. Latest consensus state: current_term: 1 leader_uuid: "02c6b264b90e45de901042c41f464a47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02c6b264b90e45de901042c41f464a47" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42325 } } }
I20260812 06:17:16.103917 31266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:16.103931 31267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "02c6b264b90e45de901042c41f464a47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02c6b264b90e45de901042c41f464a47" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42325 } } }
I20260812 06:17:16.104036 31267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:16.104804 31276 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:16.105620 31276 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:16.107383 31276 catalog_manager.cc:1347] Generated new cluster ID: 9596cbbce47c42ed9a4718d46bb79807
I20260812 06:17:16.107467 31276 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:17:16 dist-test-slave-gw5c krb5kdc[31135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:16.112706 31263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.099775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39350 (local address 127.0.176.254:42325)
0812 06:17:16.099984 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:16.099993 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:16.100021 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:17:16.101253 (+ 1232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:16.101261 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:16.101316 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:16.101450 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:16.102309 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.104186 (+ 1877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.105360 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.105968 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.106086 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.108957 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:16.108963 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:16.108963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:16.108977 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:16.110946 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:16.111418 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:16.111422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:16.111422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:16.111541 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:16.111767 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:16.111768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:16.111768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:16.112041 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:16.112243 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:16.112316 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 06:17:16.112478 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":117,"threads_started":1}
I20260812 06:17:16.149362 31276 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:16.150148 31276 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:16.158586 31276 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47: Generated new TSK 0
I20260812 06:17:16.158829 31276 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:17:16.192803 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42325
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:16.280129 31294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:16.280387 31294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:16.280431 31294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:16.281629 31294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:16.281697 31294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:16.281744 31294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:17:16.283303 31294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:16.283595 31294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:16.283859 31294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:16.288961 31300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:16.289099 31294 server_base.cc:1034] running on GCE node
W20260812 06:17:16.288975 31301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:16.288976 31306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:16.289363 31294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:16.289669 31294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:16.290876 31294 hybrid_clock.cc:648] HybridClock initialized: now 1786515436290858 us; error 28 us; skew 500 ppm
Aug 12 06:17:16 dist-test-slave-gw5c krb5kdc[31135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515436, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:16.293938 31294 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:17:16.294448 31294 webserver.cc:460] Webserver started at http://127.0.176.193:45875/ using document root <none> and password file <none>
I20260812 06:17:16.294723 31294 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:16.294802 31294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:16.294950 31294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:16.296140 31294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "c74a6d90ca42493cafa2f9d6229406d7"
format_stamp: "Formatted at 2026-08-12 06:17:16 on dist-test-slave-gw5c"
server_key: "5e774f87432b34df9f508450f5837bb4"
server_key_iv: "22d2ce0805dfe6c95dfb8d6c3c9a0e7d"
server_key_version: "encryptionkey@0"
I20260812 06:17:16.296521 31294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "c74a6d90ca42493cafa2f9d6229406d7"
format_stamp: "Formatted at 2026-08-12 06:17:16 on dist-test-slave-gw5c"
server_key: "5e774f87432b34df9f508450f5837bb4"
server_key_iv: "22d2ce0805dfe6c95dfb8d6c3c9a0e7d"
server_key_version: "encryptionkey@0"
I20260812 06:17:16.297976 31294 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:17:16.298849 31318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:16.299173 31294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:16.299286 31294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "c74a6d90ca42493cafa2f9d6229406d7"
format_stamp: "Formatted at 2026-08-12 06:17:16 on dist-test-slave-gw5c"
server_key: "5e774f87432b34df9f508450f5837bb4"
server_key_iv: "22d2ce0805dfe6c95dfb8d6c3c9a0e7d"
server_key_version: "encryptionkey@0"
I20260812 06:17:16.299367 31294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:16.317157 31294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:16.319509 31294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:16.319715 31294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:16.319991 31294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:16.320338 31294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:16.320480 31294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:16.320573 31294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:16.320607 31294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:16.327131 31294 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:44001
I20260812 06:17:16.327179 31494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:44001 every 8 connection(s)
I20260812 06:17:16.327557 31294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:17:16.329321 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 31294
I20260812 06:17:16.329473 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:17:16.329746 707 external_mini_cluster.cc:1428] Setting key 745d65ad69011ef5b57aae7adfa9519e
Aug 12 06:17:16 dist-test-slave-gw5c krb5kdc[31135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515436, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:16.338517 31263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.328364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:45497 (local address 127.0.176.254:42325)
0812 06:17:16.328446 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:16.328448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:16.328628 (+ 180us) server_negotiation.cc:407] Connection header received
0812 06:17:16.329653 (+ 1025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:16.329656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:16.329676 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:16.329748 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:16.330576 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.331333 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.332577 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.332783 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.332840 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.335490 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:16.335492 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:16.335493 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:16.335502 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:16.336988 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:16.337444 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:16.337445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:16.337446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:16.337513 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:16.337793 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:16.337794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:16.337794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:16.337932 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:16.338011 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:16.338312 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 06:17:16.338417 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 06:17:16.338728 31498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.328305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42325 (local address 127.0.176.193:45497)
0812 06:17:16.328504 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:16.328543 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:16.329534 (+ 991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:16.329854 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:16.329859 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:16.330214 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:16.330489 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:16.330494 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.331469 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.331470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:16.332481 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:16.332485 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.332875 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.332876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:16.333043 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.333620 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:16.333632 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:16.335360 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:16.337088 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:16.337097 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:16.337099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:16.337360 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:16.337592 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:16.337593 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:16.337593 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:16.337715 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:16.338001 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:16.338009 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:16.338166 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 06:17:16.338276 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 06:17:16.338463 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":106,"threads_started":1}
I20260812 06:17:16.339246 31495 heartbeater.cc:347] Connected to a master server at 127.0.176.254:42325
I20260812 06:17:16.339373 31495 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
I20260812 06:17:16.339588 31495 heartbeater.cc:511] Master 127.0.176.254:42325 requested a full tablet report, sending...
I20260812 06:17:16.340121 31207 ts_manager.cc:194] Registered new tserver with Master: c74a6d90ca42493cafa2f9d6229406d7 (127.0.176.193:44001)
I20260812 06:17:16.340811 31207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:45497
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:17:16.358639 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42325
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:16.447542 31504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:16.447768 31504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:16.447795 31504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:16.449333 31504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:16.449412 31504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:16.449445 31504 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:17:16.451180 31504 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:16.451850 31504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:16.452155 31504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:16.457415 31514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:16.457392 31512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:16.457392 31520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:16.457839 31504 server_base.cc:1034] running on GCE node
I20260812 06:17:16.458102 31504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:16.458415 31504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:16.459586 31504 hybrid_clock.cc:648] HybridClock initialized: now 1786515436459568 us; error 46 us; skew 500 ppm
Aug 12 06:17:16 dist-test-slave-gw5c krb5kdc[31135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515436, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:16.462262 31504 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:17:16.462704 31504 webserver.cc:460] Webserver started at http://127.0.176.194:37881/ using document root <none> and password file <none>
I20260812 06:17:16.462925 31504 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:16.462968 31504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:16.463064 31504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:16.464190 31504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "acd3fbed2da34c0bb6d4048de92c4b70"
format_stamp: "Formatted at 2026-08-12 06:17:16 on dist-test-slave-gw5c"
server_key: "cc6d69a7b409e97decdc041410df1581"
server_key_iv: "949de62e142d9d1021bf9a27b7de89a5"
server_key_version: "encryptionkey@0"
I20260812 06:17:16.464587 31504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "acd3fbed2da34c0bb6d4048de92c4b70"
format_stamp: "Formatted at 2026-08-12 06:17:16 on dist-test-slave-gw5c"
server_key: "cc6d69a7b409e97decdc041410df1581"
server_key_iv: "949de62e142d9d1021bf9a27b7de89a5"
server_key_version: "encryptionkey@0"
I20260812 06:17:16.465945 31504 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:17:16.466657 31534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:16.466845 31504 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:17:16.466918 31504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "acd3fbed2da34c0bb6d4048de92c4b70"
format_stamp: "Formatted at 2026-08-12 06:17:16 on dist-test-slave-gw5c"
server_key: "cc6d69a7b409e97decdc041410df1581"
server_key_iv: "949de62e142d9d1021bf9a27b7de89a5"
server_key_version: "encryptionkey@0"
I20260812 06:17:16.467011 31504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:16.484212 31504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:16.486528 31504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:16.486681 31504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:16.486967 31504 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:16.487305 31504 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:16.487341 31504 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:16.487365 31504 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:16.487444 31504 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:16.494498 31504 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:34927
I20260812 06:17:16.494549 31709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:34927 every 8 connection(s)
I20260812 06:17:16.495127 31504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:17:16 dist-test-slave-gw5c krb5kdc[31135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515436, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:16.505338 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 31504
I20260812 06:17:16.505486 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:17:16.505748 707 external_mini_cluster.cc:1428] Setting key e647438d9e23c357c6f62e3e3af53fab
I20260812 06:17:16.506793 31263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.496138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:35183 (local address 127.0.176.254:42325)
0812 06:17:16.496219 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:16.496221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:16.496404 (+ 183us) server_negotiation.cc:407] Connection header received
0812 06:17:16.497331 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:16.497333 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:16.497346 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:16.497438 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:16.498116 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.498658 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.499907 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.500128 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.500199 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.503273 (+ 3074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:16.503274 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:16.503274 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:16.503282 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:16.505046 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:16.505631 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:16.505632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:16.505632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:16.505699 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:16.506022 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:16.506023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:16.506023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:16.506175 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:16.506233 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:16.506602 (+ 369us) server_negotiation.cc:299] Negotiation successful
0812 06:17:16.506700 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 06:17:16.507023 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.496058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42325 (local address 127.0.176.194:35183)
0812 06:17:16.496237 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:16.496282 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:16.497221 (+ 939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:16.497489 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:16.497492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:16.497782 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:16.498002 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:16.498006 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.498789 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.498790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:16.499796 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:16.499799 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.500317 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.500320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:16.500739 (+ 419us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.501395 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:16.501405 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:16.503087 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:16.505139 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:16.505151 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:16.505154 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:16.505535 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:16.505773 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:16.505773 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:16.505774 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:16.505933 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:16.506249 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:16.506257 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:16.506452 (+ 195us) client_negotiation.cc:769] Sending connection context
0812 06:17:16.506576 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 06:17:16.506760 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":104,"threads_started":1}
I20260812 06:17:16.507545 31710 heartbeater.cc:347] Connected to a master server at 127.0.176.254:42325
I20260812 06:17:16.507682 31710 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:16.507936 31710 heartbeater.cc:511] Master 127.0.176.254:42325 requested a full tablet report, sending...
I20260812 06:17:16.508394 31207 ts_manager.cc:194] Registered new tserver with Master: acd3fbed2da34c0bb6d4048de92c4b70 (127.0.176.194:34927)
I20260812 06:17:16.508929 31207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:35183
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:17:16.534230 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42325
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:16.622534 31719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:16.622771 31719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:16.622799 31719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:16.624070 31719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:16.624117 31719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:16.624146 31719 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:17:16.625648 31719 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:42325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:16.625859 31719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:16.626052 31719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:16.630952 31726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:16.630970 31729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:16.630967 31727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:16.631192 31719 server_base.cc:1034] running on GCE node
I20260812 06:17:16.631660 31719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:16.631918 31719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:16.633071 31719 hybrid_clock.cc:648] HybridClock initialized: now 1786515436633058 us; error 28 us; skew 500 ppm
Aug 12 06:17:16 dist-test-slave-gw5c krb5kdc[31135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515436, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:16.636411 31719 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:17:16.636955 31719 webserver.cc:460] Webserver started at http://127.0.176.195:36147/ using document root <none> and password file <none>
I20260812 06:17:16.637207 31719 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:16.637279 31719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:16.637437 31719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:16.638581 31719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "85c30cee925a4110a9b30dfdfccf573d"
format_stamp: "Formatted at 2026-08-12 06:17:16 on dist-test-slave-gw5c"
server_key: "c0080559905790bc7e6b6a20ace4a659"
server_key_iv: "0f6c544fbc7f58a3200f66639bfe7f2a"
server_key_version: "encryptionkey@0"
I20260812 06:17:16.638981 31719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "85c30cee925a4110a9b30dfdfccf573d"
format_stamp: "Formatted at 2026-08-12 06:17:16 on dist-test-slave-gw5c"
server_key: "c0080559905790bc7e6b6a20ace4a659"
server_key_iv: "0f6c544fbc7f58a3200f66639bfe7f2a"
server_key_version: "encryptionkey@0"
I20260812 06:17:16.640478 31719 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:17:16.641255 31738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:16.641487 31719 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:16.641620 31719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "85c30cee925a4110a9b30dfdfccf573d"
format_stamp: "Formatted at 2026-08-12 06:17:16 on dist-test-slave-gw5c"
server_key: "c0080559905790bc7e6b6a20ace4a659"
server_key_iv: "0f6c544fbc7f58a3200f66639bfe7f2a"
server_key_version: "encryptionkey@0"
I20260812 06:17:16.641697 31719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:16.658138 31719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:16.660878 31719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:16.661053 31719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:16.661291 31719 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:16.661638 31719 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:16.661697 31719 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:16.661751 31719 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:16.661780 31719 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:16.668342 31719 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:36613
I20260812 06:17:16.668390 31902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:36613 every 8 connection(s)
I20260812 06:17:16.668777 31719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:17:16.670913 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 31719
I20260812 06:17:16.671028 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:17:16.671227 707 external_mini_cluster.cc:1428] Setting key ea222f73ba7dba965441400a86ce8c73
Aug 12 06:17:16 dist-test-slave-gw5c krb5kdc[31135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515436, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:16.679669 31263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.669656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:44359 (local address 127.0.176.254:42325)
0812 06:17:16.669744 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:16.669746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:16.669988 (+ 242us) server_negotiation.cc:407] Connection header received
0812 06:17:16.671053 (+ 1065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:16.671056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:16.671071 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:16.671166 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:16.672033 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.672672 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.673701 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.673899 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.673957 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.676225 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:16.676227 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:16.676227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:16.676235 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:16.677999 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:16.678565 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:16.678567 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:16.678567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:16.678686 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:16.678982 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:16.678982 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:16.678983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:16.679104 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:16.679156 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:16.679526 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 06:17:16.679599 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:17:16.679962 31906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.669627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:42325 (local address 127.0.176.195:44359)
0812 06:17:16.669845 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:16.669892 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:16.670920 (+ 1028us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:16.671230 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:16.671234 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:16.671682 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:16.671952 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:16.671958 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.672773 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.672774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:16.673605 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:16.673620 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.673980 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.673981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:16.674092 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.674610 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:16.674619 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:16.676132 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:16.678103 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:16.678117 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:16.678119 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:16.678482 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:16.678776 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:16.678777 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:16.678778 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:16.678895 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:16.679176 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:16.679182 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:16.679331 (+ 149us) client_negotiation.cc:769] Sending connection context
0812 06:17:16.679502 (+ 171us) client_negotiation.cc:240] Negotiation successful
0812 06:17:16.679669 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":137,"threads_started":1}
I20260812 06:17:16.680554 31903 heartbeater.cc:347] Connected to a master server at 127.0.176.254:42325
I20260812 06:17:16.680692 31903 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:16.680899 31903 heartbeater.cc:511] Master 127.0.176.254:42325 requested a full tablet report, sending...
I20260812 06:17:16.681298 31207 ts_manager.cc:194] Registered new tserver with Master: 85c30cee925a4110a9b30dfdfccf573d (127.0.176.195:36613)
I20260812 06:17:16.681668 31207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:44359
I20260812 06:17:16.683197 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:17:16.691939 31263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.684734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39356 (local address 127.0.176.254:42325)
0812 06:17:16.684803 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:16.684806 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:16.684938 (+ 132us) server_negotiation.cc:407] Connection header received
0812 06:17:16.684997 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:16.684998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:16.685008 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:16.685056 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:16.685713 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.686301 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.687050 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.687236 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.687292 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.688960 (+ 1668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:16.688963 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:16.688963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:16.688976 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:16.690537 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:16.691001 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:16.691001 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:16.691002 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:16.691061 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:16.691249 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:16.691250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:16.691250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:16.691385 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:16.691538 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:16.691710 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 06:17:16.691810 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:17:16.693706 31207 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39356:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:17:16.695554 31207 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:17:16.703467 31917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.698694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:34927 (local address 127.0.0.1:38270)
0812 06:17:16.699451 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:16.699462 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:16.699523 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:16.699796 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:16.699797 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:16.699799 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:16.699861 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:16.699863 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.700864 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.700865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:16.702018 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:16.702021 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.703034 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.703035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:16.703174 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.703192 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 06:17:16.703274 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 06:17:16.703333 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":109,"threads_started":1}
I20260812 06:17:16.703471 31925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.699008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38270 (local address 127.0.176.194:34927)
0812 06:17:16.699213 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:16.699216 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:16.699609 (+ 393us) server_negotiation.cc:407] Connection header received
0812 06:17:16.699664 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:16.699667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:16.699685 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:16.699956 (+ 271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:16.700041 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.700740 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.702114 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.702945 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.703016 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.703082 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:16.703305 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 06:17:16.703351 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":92,"threads_started":1}
I20260812 06:17:16.704211 31924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.698996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44001 (local address 127.0.0.1:33906)
0812 06:17:16.699325 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:16.699336 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:16.699411 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:16.699884 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:16.699885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:16.699888 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:16.699924 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:16.699926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.701469 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.701472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:16.702844 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:16.702847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.703900 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.703901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:16.703965 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.703969 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:16.704051 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 06:17:16.704100 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":37,"thread_start_us":82,"threads_started":1}
I20260812 06:17:16.704227 31926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.699256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33906 (local address 127.0.176.193:44001)
0812 06:17:16.699647 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:16.699652 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:16.699662 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:17:16.699699 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:16.699701 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:16.699718 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:16.699789 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:16.700100 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.701331 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.702951 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.703710 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.703803 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.703862 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:16.704073 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 06:17:16.704111 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":96,"threads_started":1}
I20260812 06:17:16.704476 31603 tablet_service.cc:1467] Processing CreateTablet for tablet 8b46d2564bfd4a6ea9650d08c6a27025 (DEFAULT_TABLE table=test-table [id=76c9d09be4bf44739248041afa8dbd24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:16.704816 31923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.698847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45392 (local address 127.0.176.195:36613)
0812 06:17:16.699107 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:16.699113 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:16.699165 (+ 52us) server_negotiation.cc:407] Connection header received
0812 06:17:16.699214 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:16.699224 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:16.699242 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:16.699357 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:16.699889 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.701313 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.702793 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.704052 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.704122 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.704173 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:16.704686 (+ 513us) server_negotiation.cc:299] Negotiation successful
0812 06:17:16.704734 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":101,"threads_started":1}
I20260812 06:17:16.704907 31603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b46d2564bfd4a6ea9650d08c6a27025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:16.704833 31922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:16.698693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:36613 (local address 127.0.0.1:45392)
0812 06:17:16.698939 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:16.699013 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:16.699089 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:16.699468 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:16.699471 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:16.699474 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:16.699578 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:16.699580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.701459 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.701460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:16.702695 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:16.702698 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:16.704213 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:16.704214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:16.704578 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:16.704584 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:17:16.704654 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:17:16.704751 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":129,"spinlock_wait_cycles":768,"thread_start_us":119,"threads_started":1}
I20260812 06:17:16.704962 31392 tablet_service.cc:1467] Processing CreateTablet for tablet 8b46d2564bfd4a6ea9650d08c6a27025 (DEFAULT_TABLE table=test-table [id=76c9d09be4bf44739248041afa8dbd24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:16.705350 31392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b46d2564bfd4a6ea9650d08c6a27025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:16.705811 31810 tablet_service.cc:1467] Processing CreateTablet for tablet 8b46d2564bfd4a6ea9650d08c6a27025 (DEFAULT_TABLE table=test-table [id=76c9d09be4bf44739248041afa8dbd24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:16.706219 31810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b46d2564bfd4a6ea9650d08c6a27025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:16.708341 31927 tablet_bootstrap.cc:492] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70: Bootstrap starting.
I20260812 06:17:16.709046 31927 tablet_bootstrap.cc:654] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:16.709349 31928 tablet_bootstrap.cc:492] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7: Bootstrap starting.
I20260812 06:17:16.709731 31927 log.cc:824] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:16.709869 31930 tablet_bootstrap.cc:492] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d: Bootstrap starting.
I20260812 06:17:16.710266 31928 tablet_bootstrap.cc:654] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:16.710552 31930 tablet_bootstrap.cc:654] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:16.710881 31928 log.cc:824] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:16.711195 31930 log.cc:824] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:16.711735 31928 tablet_bootstrap.cc:492] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7: No bootstrap required, opened a new log
I20260812 06:17:16.711838 31928 ts_tablet_manager.cc:1397] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:17:16.711979 31930 tablet_bootstrap.cc:492] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d: No bootstrap required, opened a new log
I20260812 06:17:16.712036 31930 ts_tablet_manager.cc:1397] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:17:16.713418 31928 raft_consensus.cc:348] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c30cee925a4110a9b30dfdfccf573d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36613 } } peers { permanent_uuid: "acd3fbed2da34c0bb6d4048de92c4b70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34927 } } peers { permanent_uuid: "c74a6d90ca42493cafa2f9d6229406d7" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44001 } }
I20260812 06:17:16.713439 31930 raft_consensus.cc:348] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c30cee925a4110a9b30dfdfccf573d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36613 } } peers { permanent_uuid: "acd3fbed2da34c0bb6d4048de92c4b70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34927 } } peers { permanent_uuid: "c74a6d90ca42493cafa2f9d6229406d7" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44001 } }
I20260812 06:17:16.713599 31930 raft_consensus.cc:374] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:16.713603 31928 raft_consensus.cc:374] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:16.713649 31930 raft_consensus.cc:729] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c30cee925a4110a9b30dfdfccf573d, State: Initialized, Role: FOLLOWER
I20260812 06:17:16.713653 31928 raft_consensus.cc:729] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74a6d90ca42493cafa2f9d6229406d7, State: Initialized, Role: FOLLOWER
I20260812 06:17:16.713778 31930 consensus_queue.cc:260] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c30cee925a4110a9b30dfdfccf573d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36613 } } peers { permanent_uuid: "acd3fbed2da34c0bb6d4048de92c4b70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34927 } } peers { permanent_uuid: "c74a6d90ca42493cafa2f9d6229406d7" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44001 } }
I20260812 06:17:16.713778 31928 consensus_queue.cc:260] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c30cee925a4110a9b30dfdfccf573d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36613 } } peers { permanent_uuid: "acd3fbed2da34c0bb6d4048de92c4b70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34927 } } peers { permanent_uuid: "c74a6d90ca42493cafa2f9d6229406d7" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44001 } }
I20260812 06:17:16.714103 31903 heartbeater.cc:503] Master 127.0.176.254:42325 was elected leader, sending a full tablet report...
I20260812 06:17:16.714131 31928 ts_tablet_manager.cc:1428] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:17:16.714135 31495 heartbeater.cc:503] Master 127.0.176.254:42325 was elected leader, sending a full tablet report...
I20260812 06:17:16.714107 31930 ts_tablet_manager.cc:1428] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:17:16.714872 31927 tablet_bootstrap.cc:492] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70: No bootstrap required, opened a new log
I20260812 06:17:16.714959 31927 ts_tablet_manager.cc:1397] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260812 06:17:16.716647 31927 raft_consensus.cc:348] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c30cee925a4110a9b30dfdfccf573d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36613 } } peers { permanent_uuid: "acd3fbed2da34c0bb6d4048de92c4b70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34927 } } peers { permanent_uuid: "c74a6d90ca42493cafa2f9d6229406d7" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44001 } }
I20260812 06:17:16.716805 31927 raft_consensus.cc:374] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:16.716828 31927 raft_consensus.cc:729] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acd3fbed2da34c0bb6d4048de92c4b70, State: Initialized, Role: FOLLOWER
I20260812 06:17:16.716928 31927 consensus_queue.cc:260] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c30cee925a4110a9b30dfdfccf573d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36613 } } peers { permanent_uuid: "acd3fbed2da34c0bb6d4048de92c4b70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34927 } } peers { permanent_uuid: "c74a6d90ca42493cafa2f9d6229406d7" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44001 } }
I20260812 06:17:16.717154 31927 ts_tablet_manager.cc:1428] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:17:16.717204 31710 heartbeater.cc:503] Master 127.0.176.254:42325 was elected leader, sending a full tablet report...
W20260812 06:17:16.745877 31712 tablet.cc:2369] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:17:16.828373 31496 tablet.cc:2369] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:17:16.919453 31905 tablet.cc:2369] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:17:17.028029 31937 raft_consensus.cc:482] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:17:17.028170 31937 raft_consensus.cc:504] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c30cee925a4110a9b30dfdfccf573d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36613 } } peers { permanent_uuid: "acd3fbed2da34c0bb6d4048de92c4b70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34927 } } peers { permanent_uuid: "c74a6d90ca42493cafa2f9d6229406d7" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44001 } }
I20260812 06:17:17.028610 31937 leader_election.cc:288] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acd3fbed2da34c0bb6d4048de92c4b70 (127.0.176.194:34927), c74a6d90ca42493cafa2f9d6229406d7 (127.0.176.193:44001)
I20260812 06:17:17.031661 31906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.028875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:34927 (local address 127.0.176.195:35421)
0812 06:17:17.029038 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:17.029052 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:17.029122 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:17.029287 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:17.029288 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:17.029290 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:17.029365 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.029369 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.030031 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.030032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.030790 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.030792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.031344 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.031345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.031464 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.031468 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:17.031540 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:17:17.031583 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260812 06:17:17.031661 31925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.029097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:35421 (local address 127.0.176.194:34927)
0812 06:17:17.029154 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.029156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.029167 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:17:17.029206 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.029206 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.029214 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.029282 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:17.029453 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.029932 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.030897 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.031259 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.031347 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.031365 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.031559 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.031600 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:17:17.031836 31926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.029120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:47633 (local address 127.0.176.193:44001)
0812 06:17:17.029173 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.029175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.029286 (+ 111us) server_negotiation.cc:407] Connection header received
0812 06:17:17.029360 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.029361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.029374 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.029453 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:17.029628 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.030091 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.031057 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.031483 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.031566 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.031575 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.031734 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.031774 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:17:17.031843 31941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.029002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44001 (local address 127.0.176.195:47633)
0812 06:17:17.029199 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:17.029211 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:17.029297 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:17.029469 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:17.029470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:17.029472 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:17.029552 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.029554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.030188 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.030189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.030957 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.030959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.031566 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.031567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.031650 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.031654 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:17.031716 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 06:17:17.031756 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":129,"threads_started":1}
I20260812 06:17:17.032078 31633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b46d2564bfd4a6ea9650d08c6a27025" candidate_uuid: "85c30cee925a4110a9b30dfdfccf573d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acd3fbed2da34c0bb6d4048de92c4b70" is_pre_election: true
I20260812 06:17:17.032140 31424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b46d2564bfd4a6ea9650d08c6a27025" candidate_uuid: "85c30cee925a4110a9b30dfdfccf573d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74a6d90ca42493cafa2f9d6229406d7" is_pre_election: true
I20260812 06:17:17.032266 31424 raft_consensus.cc:2454] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c30cee925a4110a9b30dfdfccf573d in term 0.
I20260812 06:17:17.032266 31633 raft_consensus.cc:2454] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c30cee925a4110a9b30dfdfccf573d in term 0.
I20260812 06:17:17.032505 31744 leader_election.cc:302] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c30cee925a4110a9b30dfdfccf573d, acd3fbed2da34c0bb6d4048de92c4b70; no voters:
I20260812 06:17:17.032673 31937 raft_consensus.cc:2781] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:17:17.032759 31937 raft_consensus.cc:482] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:17:17.032778 31937 raft_consensus.cc:3037] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:17.033563 31937 raft_consensus.cc:504] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c30cee925a4110a9b30dfdfccf573d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36613 } } peers { permanent_uuid: "acd3fbed2da34c0bb6d4048de92c4b70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34927 } } peers { permanent_uuid: "c74a6d90ca42493cafa2f9d6229406d7" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44001 } }
I20260812 06:17:17.033684 31937 leader_election.cc:288] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [CANDIDATE]: Term 1 election: Requested vote from peers acd3fbed2da34c0bb6d4048de92c4b70 (127.0.176.194:34927), c74a6d90ca42493cafa2f9d6229406d7 (127.0.176.193:44001)
I20260812 06:17:17.034057 31633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b46d2564bfd4a6ea9650d08c6a27025" candidate_uuid: "85c30cee925a4110a9b30dfdfccf573d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acd3fbed2da34c0bb6d4048de92c4b70"
I20260812 06:17:17.034042 31424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b46d2564bfd4a6ea9650d08c6a27025" candidate_uuid: "85c30cee925a4110a9b30dfdfccf573d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74a6d90ca42493cafa2f9d6229406d7"
I20260812 06:17:17.034157 31633 raft_consensus.cc:3037] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:17.034153 31424 raft_consensus.cc:3037] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:17.034896 31633 raft_consensus.cc:2454] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c30cee925a4110a9b30dfdfccf573d in term 1.
I20260812 06:17:17.035094 31424 raft_consensus.cc:2454] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c30cee925a4110a9b30dfdfccf573d in term 1.
I20260812 06:17:17.035138 31744 leader_election.cc:302] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c30cee925a4110a9b30dfdfccf573d, acd3fbed2da34c0bb6d4048de92c4b70; no voters:
I20260812 06:17:17.035252 31937 raft_consensus.cc:2781] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:17.035439 31937 raft_consensus.cc:686] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [term 1 LEADER]: Becoming Leader. State: Replica: 85c30cee925a4110a9b30dfdfccf573d, State: Running, Role: LEADER
I20260812 06:17:17.035575 31937 consensus_queue.cc:237] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c30cee925a4110a9b30dfdfccf573d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36613 } } peers { permanent_uuid: "acd3fbed2da34c0bb6d4048de92c4b70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34927 } } peers { permanent_uuid: "c74a6d90ca42493cafa2f9d6229406d7" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44001 } }
I20260812 06:17:17.036491 31204 catalog_manager.cc:5495] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c30cee925a4110a9b30dfdfccf573d (127.0.176.195). New cstate: current_term: 1 leader_uuid: "85c30cee925a4110a9b30dfdfccf573d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c30cee925a4110a9b30dfdfccf573d" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acd3fbed2da34c0bb6d4048de92c4b70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74a6d90ca42493cafa2f9d6229406d7" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44001 } health_report { overall_health: UNKNOWN } } }
I20260812 06:17:17.063066 31923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.060588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45396 (local address 127.0.176.195:36613)
0812 06:17:17.060646 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.060648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.060658 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:17:17.060727 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.060733 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.060752 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.060834 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:17.060983 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.061462 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.062208 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.062412 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.062490 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.062679 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:17.062779 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:17.062896 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.062966 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.062979 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:17:17.065141 31633 raft_consensus.cc:1261] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70 [term 1 FOLLOWER]: Refusing update from remote peer 85c30cee925a4110a9b30dfdfccf573d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:17.065137 31424 raft_consensus.cc:1261] T 8b46d2564bfd4a6ea9650d08c6a27025 P c74a6d90ca42493cafa2f9d6229406d7 [term 1 FOLLOWER]: Refusing update from remote peer 85c30cee925a4110a9b30dfdfccf573d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:17.065512 31937 consensus_queue.cc:1035] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74a6d90ca42493cafa2f9d6229406d7" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:17.065681 31942 consensus_queue.cc:1035] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [LEADER]: Connected to new peer: Peer: permanent_uuid: "acd3fbed2da34c0bb6d4048de92c4b70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 34927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:17.069013 31948 mvcc.cc:205] Tried to move back new op lower bound from 7317567230215430144 to 7317567230098333696. Current Snapshot: MvccSnapshot[applied={T|T < 7317567230215430144}]
I20260812 06:17:17.070569 31203 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:17:17.070694 31203 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:17:17.071597 31203 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 02c6b264b90e45de901042c41f464a47: Sending DeleteTablet for 3 replicas of tablet 8b46d2564bfd4a6ea9650d08c6a27025
I20260812 06:17:17.071947 31603 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b46d2564bfd4a6ea9650d08c6a27025 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:17 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:38270
I20260812 06:17:17.071988 31392 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b46d2564bfd4a6ea9650d08c6a27025 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:17 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:33906
I20260812 06:17:17.071982 31810 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b46d2564bfd4a6ea9650d08c6a27025 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:17 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:45392
I20260812 06:17:17.072579 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 31294
I20260812 06:17:17.075742 31965 tablet_replica.cc:330] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d: stopping tablet replica
I20260812 06:17:17.075868 31964 tablet_replica.cc:330] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70: stopping tablet replica
I20260812 06:17:17.076072 31965 raft_consensus.cc:2229] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:17:17.076246 31964 raft_consensus.cc:2229] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:17:17.076452 31965 raft_consensus.cc:2258] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:17.076656 31964 raft_consensus.cc:2258] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:17.077344 31964 ts_tablet_manager.cc:1905] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:17:17.079342 31964 ts_tablet_manager.cc:1918] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:17:17.079465 31964 log.cc:1196] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/8b46d2564bfd4a6ea9650d08c6a27025
I20260812 06:17:17.079767 31964 ts_tablet_manager.cc:1939] T 8b46d2564bfd4a6ea9650d08c6a27025 P acd3fbed2da34c0bb6d4048de92c4b70: Deleting consensus metadata
I20260812 06:17:17.080289 31189 catalog_manager.cc:4841] TS acd3fbed2da34c0bb6d4048de92c4b70 (127.0.176.194:34927): tablet 8b46d2564bfd4a6ea9650d08c6a27025 (table test-table [id=76c9d09be4bf44739248041afa8dbd24]) successfully deleted
W20260812 06:17:17.083756 31189 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:44001 (error 108)
I20260812 06:17:17.084038 31965 ts_tablet_manager.cc:1905] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:17:17.084352 31922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.084204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44001 (local address 127.0.0.1:33908)
0812 06:17:17.084268 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:17.084314 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:44001: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 06:17:17.084488 31189 catalog_manager.cc:4584] TS c74a6d90ca42493cafa2f9d6229406d7 (127.0.176.193:44001): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8b46d2564bfd4a6ea9650d08c6a27025: Network error: Client connection negotiation failed: client connection to 127.0.176.193:44001: connect: Connection refused (error 111)
I20260812 06:17:17.084836 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 31504
I20260812 06:17:17.087930 31965 ts_tablet_manager.cc:1918] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:17:17.088011 31965 log.cc:1196] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/8b46d2564bfd4a6ea9650d08c6a27025
I20260812 06:17:17.088266 31965 ts_tablet_manager.cc:1939] T 8b46d2564bfd4a6ea9650d08c6a27025 P 85c30cee925a4110a9b30dfdfccf573d: Deleting consensus metadata
I20260812 06:17:17.089985 31186 catalog_manager.cc:4841] TS 85c30cee925a4110a9b30dfdfccf573d (127.0.176.195:36613): tablet 8b46d2564bfd4a6ea9650d08c6a27025 (table test-table [id=76c9d09be4bf44739248041afa8dbd24]) successfully deleted
I20260812 06:17:17.114733 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 31719
I20260812 06:17:17.127650 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 31159
2026-08-12T06:17:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2594 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T06:17:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:17Z Disabled control of system clock
I20260812 06:17:17.169730 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:37109
--webserver_interface=127.0.176.254
--webserver_port=0
--builtin_ntp_servers=127.0.176.212:42763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:37109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:17:17.254894 31973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:17.255111 31973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:17.255132 31973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:17.256326 31973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:17.256377 31973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:17.256390 31973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:17.256402 31973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:17.256415 31973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:17.257787 31973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:37109
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:37109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:17.258051 31973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:17.258383 31973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:17.263231 31983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:17.263307 31980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:17.263245 31985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:17.263581 31973 server_base.cc:1034] running on GCE node
I20260812 06:17:17.264029 31973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:17.264429 31973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:17.265586 31973 hybrid_clock.cc:648] HybridClock initialized: now 1786515437265565 us; error 42 us; skew 500 ppm
I20260812 06:17:17.266875 31973 webserver.cc:460] Webserver started at http://127.0.176.254:44987/ using document root <none> and password file <none>
I20260812 06:17:17.267165 31973 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:17.267234 31973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:17.267433 31973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:17.268574 31973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "9aab3f9ab67349aa94cdc8425c8328c9"
format_stamp: "Formatted at 2026-08-12 06:17:17 on dist-test-slave-gw5c"
server_key: "f8d6ab45ce246b6439503dc56f5154a7"
server_key_iv: "ecd764bca657fc8972c4989b059d197d"
server_key_version: "encryptionkey@0"
I20260812 06:17:17.268956 31973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "9aab3f9ab67349aa94cdc8425c8328c9"
format_stamp: "Formatted at 2026-08-12 06:17:17 on dist-test-slave-gw5c"
server_key: "f8d6ab45ce246b6439503dc56f5154a7"
server_key_iv: "ecd764bca657fc8972c4989b059d197d"
server_key_version: "encryptionkey@0"
I20260812 06:17:17.270560 31973 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:17:17.271497 31992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:17.271735 31973 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:17.271844 31973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "9aab3f9ab67349aa94cdc8425c8328c9"
format_stamp: "Formatted at 2026-08-12 06:17:17 on dist-test-slave-gw5c"
server_key: "f8d6ab45ce246b6439503dc56f5154a7"
server_key_iv: "ecd764bca657fc8972c4989b059d197d"
server_key_version: "encryptionkey@0"
I20260812 06:17:17.271946 31973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:17.297145 31973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:17.297539 31973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:17.297835 31973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:17.302578 32074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:37109 every 8 connection(s)
I20260812 06:17:17.302546 31973 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:37109
I20260812 06:17:17.303092 31973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:17.304201 32075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:17.305428 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 31973
I20260812 06:17:17.305563 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:17.305863 707 external_mini_cluster.cc:1428] Setting key d2fc816fe40e414e137a17ef457b7e8d
I20260812 06:17:17.306998 32075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9: Bootstrap starting.
I20260812 06:17:17.307796 32075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:17.308112 32075 log.cc:824] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:17.308914 32075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9: No bootstrap required, opened a new log
I20260812 06:17:17.311622 32075 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aab3f9ab67349aa94cdc8425c8328c9" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37109 } }
I20260812 06:17:17.311854 32075 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:17.311909 32075 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aab3f9ab67349aa94cdc8425c8328c9, State: Initialized, Role: FOLLOWER
I20260812 06:17:17.312044 32075 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aab3f9ab67349aa94cdc8425c8328c9" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37109 } }
I20260812 06:17:17.312144 32075 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:17.312176 32079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.306462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60850 (local address 127.0.176.254:37109)
0812 06:17:17.306657 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.306664 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.306689 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:17:17.307120 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.307129 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.307206 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.307326 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:17.307633 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.308645 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.309720 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.310148 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.310251 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.311182 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:17.311187 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:17.311188 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:17.311369 (+ 181us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:17.311478 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:17.311491 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:17.311551 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.311701 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.311923 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":79,"threads_started":1}
I20260812 06:17:17.312191 32075 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:17.312271 32075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:17.312909 32075 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aab3f9ab67349aa94cdc8425c8328c9" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37109 } }
I20260812 06:17:17.313038 32075 leader_election.cc:302] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9aab3f9ab67349aa94cdc8425c8328c9; no voters:
I20260812 06:17:17.313248 32075 leader_election.cc:288] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:17.313285 32083 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:17.313511 32083 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [term 1 LEADER]: Becoming Leader. State: Replica: 9aab3f9ab67349aa94cdc8425c8328c9, State: Running, Role: LEADER
I20260812 06:17:17.313558 32075 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:17.313608 32083 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aab3f9ab67349aa94cdc8425c8328c9" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37109 } }
I20260812 06:17:17.314011 32085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9aab3f9ab67349aa94cdc8425c8328c9. Latest consensus state: current_term: 1 leader_uuid: "9aab3f9ab67349aa94cdc8425c8328c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aab3f9ab67349aa94cdc8425c8328c9" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37109 } } }
I20260812 06:17:17.314119 32085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:17.314007 32084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9aab3f9ab67349aa94cdc8425c8328c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aab3f9ab67349aa94cdc8425c8328c9" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 37109 } } }
I20260812 06:17:17.314286 32084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:17.314354 32093 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:17.314865 32093 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:17.316511 32093 catalog_manager.cc:1347] Generated new cluster ID: 173c367fc41346dcbbf139510a96ce78
I20260812 06:17:17.316568 32093 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:17.339197 32093 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:17.339967 32093 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:17.346668 32093 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9: Generated new TSK 0
I20260812 06:17:17.346909 32093 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:17.358289 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37109
--builtin_ntp_servers=127.0.176.212:42763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:17:17.451071 32106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:17.451304 32106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:17.451329 32106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:17.452601 32106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:17.452653 32106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:17.452679 32106 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:17:17.454129 32106 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:17.454432 32106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:17.454774 32106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:17.460136 32116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:17.460131 32118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:17.460309 32114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:17.460376 32106 server_base.cc:1034] running on GCE node
I20260812 06:17:17.460569 32106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:17.460876 32106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:17.462067 32106 hybrid_clock.cc:648] HybridClock initialized: now 1786515437462053 us; error 32 us; skew 500 ppm
I20260812 06:17:17.463503 32106 webserver.cc:460] Webserver started at http://127.0.176.193:38181/ using document root <none> and password file <none>
I20260812 06:17:17.463775 32106 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:17.463850 32106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:17.464016 32106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:17.465366 32106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "8d11b339bf6d4966befbd89dbd6630e3"
format_stamp: "Formatted at 2026-08-12 06:17:17 on dist-test-slave-gw5c"
server_key: "4b9901f6b7768263202a4080cc97af37"
server_key_iv: "e2a192cfd04bceed7ca640c5ea8d1339"
server_key_version: "encryptionkey@0"
I20260812 06:17:17.465806 32106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "8d11b339bf6d4966befbd89dbd6630e3"
format_stamp: "Formatted at 2026-08-12 06:17:17 on dist-test-slave-gw5c"
server_key: "4b9901f6b7768263202a4080cc97af37"
server_key_iv: "e2a192cfd04bceed7ca640c5ea8d1339"
server_key_version: "encryptionkey@0"
I20260812 06:17:17.467319 32106 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260812 06:17:17.468335 32129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:17.468631 32106 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:17.468745 32106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "8d11b339bf6d4966befbd89dbd6630e3"
format_stamp: "Formatted at 2026-08-12 06:17:17 on dist-test-slave-gw5c"
server_key: "4b9901f6b7768263202a4080cc97af37"
server_key_iv: "e2a192cfd04bceed7ca640c5ea8d1339"
server_key_version: "encryptionkey@0"
I20260812 06:17:17.468832 32106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:17.481765 32106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:17.482146 32106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:17.482304 32106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:17.482565 32106 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:17.482924 32106 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:17.482981 32106 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:17.483018 32106 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:17.483045 32106 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:17.489224 32106 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:38647
I20260812 06:17:17.489362 32294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:38647 every 8 connection(s)
I20260812 06:17:17.489683 32106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:17:17.495009 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 32106
I20260812 06:17:17.495150 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:17:17.495445 707 external_mini_cluster.cc:1428] Setting key 61b32bdc9d5ca8490a006aaae6bd851d
I20260812 06:17:17.495432 32079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.490535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:56121 (local address 127.0.176.254:37109)
0812 06:17:17.490632 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.490635 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.490914 (+ 279us) server_negotiation.cc:407] Connection header received
0812 06:17:17.491485 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.491487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.491500 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.491557 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:17.492273 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.492786 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.493805 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.494021 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.494081 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.495037 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:17.495038 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:17.495039 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:17.495044 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:17.495057 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:17.495061 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:17.495137 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.495283 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.495315 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 06:17:17.495709 32300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.490503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:37109 (local address 127.0.176.193:56121)
0812 06:17:17.490772 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:17.490818 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:17.491314 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:17.491650 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:17.491653 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:17.491662 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:17.492177 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.492181 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.492897 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.492898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.493708 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.493710 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.494102 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.494103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.494217 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.494861 (+ 644us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:17:17.494861 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:17.494902 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:17:17.494933 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:17.495162 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:17.495171 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:17.495175 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:17.495273 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 06:17:17.495428 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":129,"threads_started":1}
I20260812 06:17:17.496376 32295 heartbeater.cc:347] Connected to a master server at 127.0.176.254:37109
I20260812 06:17:17.496495 32295 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:17.496654 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37109
--builtin_ntp_servers=127.0.176.212:42763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 06:17:17.496687 32295 heartbeater.cc:511] Master 127.0.176.254:37109 requested a full tablet report, sending...
I20260812 06:17:17.497236 32019 ts_manager.cc:194] Registered new tserver with Master: 8d11b339bf6d4966befbd89dbd6630e3 (127.0.176.193:38647)
I20260812 06:17:17.497888 32019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.176.193:56121
W20260812 06:17:17.585291 32301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:17.585521 32301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:17.585546 32301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:17.586804 32301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:17.586853 32301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:17.586880 32301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:17:17.588301 32301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:17.588598 32301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:17.588936 32301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:17.594413 32311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:17.594414 32308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:17.594468 32309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:17.594758 32301 server_base.cc:1034] running on GCE node
I20260812 06:17:17.595017 32301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:17.595278 32301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:17.596485 32301 hybrid_clock.cc:648] HybridClock initialized: now 1786515437596471 us; error 48 us; skew 500 ppm
I20260812 06:17:17.597877 32301 webserver.cc:460] Webserver started at http://127.0.176.194:43293/ using document root <none> and password file <none>
I20260812 06:17:17.598127 32301 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:17.598174 32301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:17.598337 32301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:17.599547 32301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "146f40bf48ac4e3d9995ea07461c4383"
format_stamp: "Formatted at 2026-08-12 06:17:17 on dist-test-slave-gw5c"
server_key: "caf711e54e96eeb7e4f86d8f74d637ae"
server_key_iv: "6eb175e8a0268771a9eece0ce1cb7061"
server_key_version: "encryptionkey@0"
I20260812 06:17:17.599910 32301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "146f40bf48ac4e3d9995ea07461c4383"
format_stamp: "Formatted at 2026-08-12 06:17:17 on dist-test-slave-gw5c"
server_key: "caf711e54e96eeb7e4f86d8f74d637ae"
server_key_iv: "6eb175e8a0268771a9eece0ce1cb7061"
server_key_version: "encryptionkey@0"
I20260812 06:17:17.601249 32301 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:17:17.601994 32319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:17.602190 32301 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:17:17.602280 32301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "146f40bf48ac4e3d9995ea07461c4383"
format_stamp: "Formatted at 2026-08-12 06:17:17 on dist-test-slave-gw5c"
server_key: "caf711e54e96eeb7e4f86d8f74d637ae"
server_key_iv: "6eb175e8a0268771a9eece0ce1cb7061"
server_key_version: "encryptionkey@0"
I20260812 06:17:17.602355 32301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:17.621760 32301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:17.622156 32301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:17.622357 32301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:17.622623 32301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:17.623067 32301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:17.623122 32301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:17.623168 32301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:17.623199 32301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:17.629130 32301 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:45329
I20260812 06:17:17.629176 32490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:45329 every 8 connection(s)
I20260812 06:17:17.629565 32301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:17:17.633324 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 32301
I20260812 06:17:17.633464 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:17:17.633684 707 external_mini_cluster.cc:1428] Setting key e0dd3bcf64bcc49dced247a55efc1d84
I20260812 06:17:17.635031 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37109
--builtin_ntp_servers=127.0.176.212:42763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 06:17:17.635493 32079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.630395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:57457 (local address 127.0.176.254:37109)
0812 06:17:17.630457 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.630459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.630809 (+ 350us) server_negotiation.cc:407] Connection header received
0812 06:17:17.631317 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.631321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.631333 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.631457 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:17.632195 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.632721 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.633858 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.634083 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.634147 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.635176 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:17.635178 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:17.635178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:17.635184 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:17.635199 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:17.635204 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:17.635271 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.635353 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.635382 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:17:17.635736 32493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.630342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:37109 (local address 127.0.176.194:57457)
0812 06:17:17.630540 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:17.630584 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:17.631220 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:17.631532 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:17.631536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:17.631545 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:17.632099 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.632103 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.632816 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.632817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.633738 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.633741 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.634164 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.634165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.634330 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.635025 (+ 695us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:17:17.635025 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:17.635055 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:17:17.635079 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:17.635271 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:17.635278 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:17.635282 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:17.635347 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 06:17:17.635490 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":98,"threads_started":1}
I20260812 06:17:17.636204 32491 heartbeater.cc:347] Connected to a master server at 127.0.176.254:37109
I20260812 06:17:17.636300 32491 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:17.636516 32491 heartbeater.cc:511] Master 127.0.176.254:37109 requested a full tablet report, sending...
I20260812 06:17:17.636963 32019 ts_manager.cc:194] Registered new tserver with Master: 146f40bf48ac4e3d9995ea07461c4383 (127.0.176.194:45329)
I20260812 06:17:17.637401 32019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.176.194:57457
W20260812 06:17:17.721717 32494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:17.721946 32494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:17.721969 32494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:17.723240 32494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:17.723299 32494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:17.723327 32494 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:17:17.725433 32494 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:42763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:37109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:17.725664 32494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:17.725953 32494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:17.731081 32503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:17.731073 32508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:17.731070 32501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:17.731280 32494 server_base.cc:1034] running on GCE node
I20260812 06:17:17.731542 32494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:17.731774 32494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:17.732919 32494 hybrid_clock.cc:648] HybridClock initialized: now 1786515437732893 us; error 44 us; skew 500 ppm
I20260812 06:17:17.734328 32494 webserver.cc:460] Webserver started at http://127.0.176.195:43299/ using document root <none> and password file <none>
I20260812 06:17:17.734607 32494 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:17.734656 32494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:17.734828 32494 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:17.736012 32494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "b333dcfb99af4043a858decc42c4c2d7"
format_stamp: "Formatted at 2026-08-12 06:17:17 on dist-test-slave-gw5c"
server_key: "1aa69ea6e323132070d5ee8f05540194"
server_key_iv: "d0b455796acdfc14a2ddbc50d1511c86"
server_key_version: "encryptionkey@0"
I20260812 06:17:17.736379 32494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "b333dcfb99af4043a858decc42c4c2d7"
format_stamp: "Formatted at 2026-08-12 06:17:17 on dist-test-slave-gw5c"
server_key: "1aa69ea6e323132070d5ee8f05540194"
server_key_iv: "d0b455796acdfc14a2ddbc50d1511c86"
server_key_version: "encryptionkey@0"
I20260812 06:17:17.737725 32494 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:17:17.738441 32520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:17.738619 32494 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:17:17.738710 32494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "b333dcfb99af4043a858decc42c4c2d7"
format_stamp: "Formatted at 2026-08-12 06:17:17 on dist-test-slave-gw5c"
server_key: "1aa69ea6e323132070d5ee8f05540194"
server_key_iv: "d0b455796acdfc14a2ddbc50d1511c86"
server_key_version: "encryptionkey@0"
I20260812 06:17:17.738786 32494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:17.748525 32494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:17.748855 32494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:17.749017 32494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:17.749259 32494 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:17.749631 32494 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:17.749688 32494 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:17.749724 32494 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:17.749752 32494 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:17.756021 32494 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:42055
I20260812 06:17:17.756076 32692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:42055 every 8 connection(s)
I20260812 06:17:17.756531 32494 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:17:17.761900 32079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.757367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:51639 (local address 127.0.176.254:37109)
0812 06:17:17.757425 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.757427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.757693 (+ 266us) server_negotiation.cc:407] Connection header received
0812 06:17:17.758151 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.758152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.758163 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.758231 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:17.758928 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.759456 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.760458 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.760657 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.760715 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.761594 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:17.761596 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:17.761596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:17.761601 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:17.761623 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:17.761628 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:17.761679 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.761770 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.761799 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:17:17.761931 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 32494
I20260812 06:17:17.762036 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:17:17.762041 32696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.757334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:37109 (local address 127.0.176.195:51639)
0812 06:17:17.757530 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:17.757573 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:17.758067 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:17.758309 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:17.758313 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:17.758322 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:17.758843 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.758847 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.759536 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.759537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.760376 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.760379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.760739 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.760740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.760859 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.761447 (+ 588us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:17:17.761448 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:17.761486 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:17:17.761510 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:17.761691 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:17.761695 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:17.761698 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:17:17.761751 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:17:17.761839 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":98,"threads_started":1}
I20260812 06:17:17.762288 707 external_mini_cluster.cc:1428] Setting key 308cb48cc909390a5affc4a52f7e2bbe
I20260812 06:17:17.762612 32693 heartbeater.cc:347] Connected to a master server at 127.0.176.254:37109
I20260812 06:17:17.762717 32693 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:17.762924 32693 heartbeater.cc:511] Master 127.0.176.254:37109 requested a full tablet report, sending...
I20260812 06:17:17.763288 32019 ts_manager.cc:194] Registered new tserver with Master: b333dcfb99af4043a858decc42c4c2d7 (127.0.176.195:42055)
I20260812 06:17:17.763705 32019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.176.195:51639
I20260812 06:17:17.774578 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:17:17.779320 32079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.776254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60854 (local address 127.0.176.254:37109)
0812 06:17:17.776321 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.776324 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.776470 (+ 146us) server_negotiation.cc:407] Connection header received
0812 06:17:17.776518 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.776519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.776529 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.776580 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:17.776724 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.777213 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.777959 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.778144 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.778202 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.778981 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:17.778982 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:17.778983 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:17.778988 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:17.779002 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:17.779006 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:17.779080 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.779168 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.779206 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:17:17.781538 32019 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60854:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:17:17.783278 32019 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:17:17.790544 32713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.786161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41404 (local address 127.0.176.193:38647)
0812 06:17:17.786713 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.786717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.786727 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:17:17.786777 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.786780 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.786795 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.787013 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:17.787075 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.788125 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.789488 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.790189 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.790277 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.790369 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.790396 (+ 27us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.790435 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":103,"threads_started":1}
I20260812 06:17:17.790731 32714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.786170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35638 (local address 127.0.176.195:42055)
0812 06:17:17.786352 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.786380 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.786403 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:17:17.786437 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.786438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.786457 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.786570 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:17.786795 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.787981 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.789303 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.790053 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.790127 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.790218 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.790612 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.790657 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":97,"threads_started":1}
I20260812 06:17:17.790805 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.786376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38686 (local address 127.0.176.194:45329)
0812 06:17:17.786550 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.786555 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.786675 (+ 120us) server_negotiation.cc:407] Connection header received
0812 06:17:17.786760 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.786762 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.786777 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.786846 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:17.787095 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.787917 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.789500 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.789999 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.790091 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.790195 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.790546 (+ 351us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.790599 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":100,"threads_started":1}
I20260812 06:17:17.790953 32710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.785910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:45329 (local address 127.0.0.1:38686)
0812 06:17:17.786590 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:17.786600 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:17.786688 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:17.786952 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:17.786953 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:17.786955 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:17.787009 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.787011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.788006 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.788007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.789391 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.789394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.790103 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.790104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.790185 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.790200 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 06:17:17.790267 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:17:17.790325 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":81,"thread_start_us":93,"threads_started":1}
I20260812 06:17:17.791072 32708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.785875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:42055 (local address 127.0.0.1:35638)
0812 06:17:17.786012 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:17.786057 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:17.786129 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:17.786577 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:17.786580 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:17.786583 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:17.786692 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.786695 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.788077 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.788078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.789192 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.789195 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.790257 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.790258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.790319 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.790323 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:17.790372 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 06:17:17.790921 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":65,"thread_start_us":82,"threads_started":1}
I20260812 06:17:17.791308 32709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.785906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:38647 (local address 127.0.0.1:41404)
0812 06:17:17.786052 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:17.786061 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:17.786129 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:17.786895 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:17.786895 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:17.786898 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:17.786942 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.786944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.788203 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.788204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.789390 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.789394 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.790279 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.790280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.790331 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.790335 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:17.790376 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 06:17:17.790989 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":7,"thread_start_us":81,"threads_started":1}
I20260812 06:17:17.791872 32594 tablet_service.cc:1467] Processing CreateTablet for tablet 7e1cecf77c1540bba9a9314c920c4a27 (DEFAULT_TABLE table=test-table [id=dfa681f613f14d5abe57681ff5da6175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:17.791836 32394 tablet_service.cc:1467] Processing CreateTablet for tablet 7e1cecf77c1540bba9a9314c920c4a27 (DEFAULT_TABLE table=test-table [id=dfa681f613f14d5abe57681ff5da6175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:17.792260 32594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e1cecf77c1540bba9a9314c920c4a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:17.792260 32394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e1cecf77c1540bba9a9314c920c4a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:17.795967 32717 tablet_bootstrap.cc:492] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7: Bootstrap starting.
I20260812 06:17:17.796344 32212 tablet_service.cc:1467] Processing CreateTablet for tablet 7e1cecf77c1540bba9a9314c920c4a27 (DEFAULT_TABLE table=test-table [id=dfa681f613f14d5abe57681ff5da6175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:17.796684 32717 tablet_bootstrap.cc:654] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:17.796725 32212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e1cecf77c1540bba9a9314c920c4a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:17.797000 32717 log.cc:824] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:17.797364 32719 tablet_bootstrap.cc:492] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383: Bootstrap starting.
I20260812 06:17:17.797827 32717 tablet_bootstrap.cc:492] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7: No bootstrap required, opened a new log
I20260812 06:17:17.797901 32717 ts_tablet_manager.cc:1397] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:17:17.798151 32719 tablet_bootstrap.cc:654] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:17.798480 32719 log.cc:824] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:17.799261 32719 tablet_bootstrap.cc:492] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383: No bootstrap required, opened a new log
I20260812 06:17:17.799350 32719 ts_tablet_manager.cc:1397] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:17:17.800697 32724 tablet_bootstrap.cc:492] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3: Bootstrap starting.
I20260812 06:17:17.800768 32717 raft_consensus.cc:348] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b333dcfb99af4043a858decc42c4c2d7" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42055 } } peers { permanent_uuid: "146f40bf48ac4e3d9995ea07461c4383" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 45329 } } peers { permanent_uuid: "8d11b339bf6d4966befbd89dbd6630e3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38647 } }
I20260812 06:17:17.800966 32717 raft_consensus.cc:374] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:17.801013 32717 raft_consensus.cc:729] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b333dcfb99af4043a858decc42c4c2d7, State: Initialized, Role: FOLLOWER
I20260812 06:17:17.801173 32717 consensus_queue.cc:260] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b333dcfb99af4043a858decc42c4c2d7" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42055 } } peers { permanent_uuid: "146f40bf48ac4e3d9995ea07461c4383" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 45329 } } peers { permanent_uuid: "8d11b339bf6d4966befbd89dbd6630e3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38647 } }
I20260812 06:17:17.801497 32717 ts_tablet_manager.cc:1428] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 06:17:17.801648 32693 heartbeater.cc:503] Master 127.0.176.254:37109 was elected leader, sending a full tablet report...
I20260812 06:17:17.802142 32724 tablet_bootstrap.cc:654] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:17.802047 32719 raft_consensus.cc:348] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b333dcfb99af4043a858decc42c4c2d7" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42055 } } peers { permanent_uuid: "146f40bf48ac4e3d9995ea07461c4383" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 45329 } } peers { permanent_uuid: "8d11b339bf6d4966befbd89dbd6630e3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38647 } }
I20260812 06:17:17.802213 32719 raft_consensus.cc:374] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:17.802251 32719 raft_consensus.cc:729] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146f40bf48ac4e3d9995ea07461c4383, State: Initialized, Role: FOLLOWER
I20260812 06:17:17.802405 32719 consensus_queue.cc:260] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b333dcfb99af4043a858decc42c4c2d7" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42055 } } peers { permanent_uuid: "146f40bf48ac4e3d9995ea07461c4383" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 45329 } } peers { permanent_uuid: "8d11b339bf6d4966befbd89dbd6630e3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38647 } }
I20260812 06:17:17.802495 32724 log.cc:824] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:17.802688 32719 ts_tablet_manager.cc:1428] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:17:17.802881 32491 heartbeater.cc:503] Master 127.0.176.254:37109 was elected leader, sending a full tablet report...
I20260812 06:17:17.803524 32724 tablet_bootstrap.cc:492] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3: No bootstrap required, opened a new log
I20260812 06:17:17.803620 32724 ts_tablet_manager.cc:1397] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:17:17.805608 32724 raft_consensus.cc:348] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b333dcfb99af4043a858decc42c4c2d7" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42055 } } peers { permanent_uuid: "146f40bf48ac4e3d9995ea07461c4383" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 45329 } } peers { permanent_uuid: "8d11b339bf6d4966befbd89dbd6630e3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38647 } }
I20260812 06:17:17.805780 32724 raft_consensus.cc:374] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:17.805833 32724 raft_consensus.cc:729] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d11b339bf6d4966befbd89dbd6630e3, State: Initialized, Role: FOLLOWER
I20260812 06:17:17.805964 32724 consensus_queue.cc:260] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b333dcfb99af4043a858decc42c4c2d7" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42055 } } peers { permanent_uuid: "146f40bf48ac4e3d9995ea07461c4383" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 45329 } } peers { permanent_uuid: "8d11b339bf6d4966befbd89dbd6630e3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38647 } }
I20260812 06:17:17.806296 32724 ts_tablet_manager.cc:1428] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:17:17.806352 32295 heartbeater.cc:503] Master 127.0.176.254:37109 was elected leader, sending a full tablet report...
I20260812 06:17:17.807191 32732 raft_consensus.cc:482] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:17:17.807291 32732 raft_consensus.cc:504] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b333dcfb99af4043a858decc42c4c2d7" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42055 } } peers { permanent_uuid: "146f40bf48ac4e3d9995ea07461c4383" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 45329 } } peers { permanent_uuid: "8d11b339bf6d4966befbd89dbd6630e3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38647 } }
I20260812 06:17:17.807852 32732 leader_election.cc:288] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b333dcfb99af4043a858decc42c4c2d7 (127.0.176.195:42055), 146f40bf48ac4e3d9995ea07461c4383 (127.0.176.194:45329)
I20260812 06:17:17.810503 32300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.807800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:45329 (local address 127.0.176.193:59451)
0812 06:17:17.807849 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:17.807862 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:17.807911 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:17.808113 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:17.808113 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:17.808115 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:17.808188 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.808190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.808860 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.808861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.809671 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.809674 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.810257 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.810258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.810330 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.810336 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:17:17.810390 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:17:17.810436 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 06:17:17.810513 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.807940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:59451 (local address 127.0.176.194:45329)
0812 06:17:17.807987 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.807989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.807998 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:17:17.808030 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.808030 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.808041 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.808093 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:17.808266 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.808775 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.809764 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.810178 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.810234 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.810243 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.810404 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.810441 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:17:17.810690 32733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.807809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:42055 (local address 127.0.176.193:50511)
0812 06:17:17.807993 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:17.808004 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:17.808055 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:17.808199 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:17.808199 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:17.808201 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:17.808289 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.808291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.809042 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.809043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.809818 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:17.809820 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.810414 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.810416 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:17.810494 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.810498 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:17.810559 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:17:17.810604 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":23,"thread_start_us":108,"threads_started":1}
I20260812 06:17:17.810873 32423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e1cecf77c1540bba9a9314c920c4a27" candidate_uuid: "8d11b339bf6d4966befbd89dbd6630e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146f40bf48ac4e3d9995ea07461c4383" is_pre_election: true
I20260812 06:17:17.811026 32423 raft_consensus.cc:2454] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d11b339bf6d4966befbd89dbd6630e3 in term 0.
I20260812 06:17:17.811121 32714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.808014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:50511 (local address 127.0.176.195:42055)
0812 06:17:17.808057 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.808059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.808067 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:17:17.808116 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.808116 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.808126 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.808186 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:17.808367 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.808954 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.809908 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.810294 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.810380 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.810389 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.811012 (+ 623us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.811056 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:17:17.811275 32134 leader_election.cc:302] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146f40bf48ac4e3d9995ea07461c4383, 8d11b339bf6d4966befbd89dbd6630e3; no voters:
I20260812 06:17:17.811448 32732 raft_consensus.cc:2781] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:17:17.811456 32627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e1cecf77c1540bba9a9314c920c4a27" candidate_uuid: "8d11b339bf6d4966befbd89dbd6630e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b333dcfb99af4043a858decc42c4c2d7" is_pre_election: true
I20260812 06:17:17.811525 32732 raft_consensus.cc:482] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:17:17.811553 32732 raft_consensus.cc:3037] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:17.811587 32627 raft_consensus.cc:2454] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d11b339bf6d4966befbd89dbd6630e3 in term 0.
I20260812 06:17:17.812436 32732 raft_consensus.cc:504] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b333dcfb99af4043a858decc42c4c2d7" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42055 } } peers { permanent_uuid: "146f40bf48ac4e3d9995ea07461c4383" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 45329 } } peers { permanent_uuid: "8d11b339bf6d4966befbd89dbd6630e3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38647 } }
I20260812 06:17:17.812587 32732 leader_election.cc:288] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [CANDIDATE]: Term 1 election: Requested vote from peers b333dcfb99af4043a858decc42c4c2d7 (127.0.176.195:42055), 146f40bf48ac4e3d9995ea07461c4383 (127.0.176.194:45329)
I20260812 06:17:17.812737 32627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e1cecf77c1540bba9a9314c920c4a27" candidate_uuid: "8d11b339bf6d4966befbd89dbd6630e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b333dcfb99af4043a858decc42c4c2d7"
I20260812 06:17:17.812757 32423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e1cecf77c1540bba9a9314c920c4a27" candidate_uuid: "8d11b339bf6d4966befbd89dbd6630e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146f40bf48ac4e3d9995ea07461c4383"
I20260812 06:17:17.812830 32423 raft_consensus.cc:3037] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:17.812830 32627 raft_consensus.cc:3037] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:17.813786 32627 raft_consensus.cc:2454] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d11b339bf6d4966befbd89dbd6630e3 in term 1.
I20260812 06:17:17.813786 32423 raft_consensus.cc:2454] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d11b339bf6d4966befbd89dbd6630e3 in term 1.
I20260812 06:17:17.813995 32134 leader_election.cc:302] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146f40bf48ac4e3d9995ea07461c4383, 8d11b339bf6d4966befbd89dbd6630e3; no voters:
I20260812 06:17:17.814215 32732 raft_consensus.cc:2781] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:17.814378 32732 raft_consensus.cc:686] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [term 1 LEADER]: Becoming Leader. State: Replica: 8d11b339bf6d4966befbd89dbd6630e3, State: Running, Role: LEADER
I20260812 06:17:17.814486 32732 consensus_queue.cc:237] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b333dcfb99af4043a858decc42c4c2d7" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42055 } } peers { permanent_uuid: "146f40bf48ac4e3d9995ea07461c4383" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 45329 } } peers { permanent_uuid: "8d11b339bf6d4966befbd89dbd6630e3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38647 } }
I20260812 06:17:17.815369 32021 catalog_manager.cc:5495] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d11b339bf6d4966befbd89dbd6630e3 (127.0.176.193). New cstate: current_term: 1 leader_uuid: "8d11b339bf6d4966befbd89dbd6630e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b333dcfb99af4043a858decc42c4c2d7" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146f40bf48ac4e3d9995ea07461c4383" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 45329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d11b339bf6d4966befbd89dbd6630e3" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 38647 } health_report { overall_health: HEALTHY } } }
I20260812 06:17:17.827013 32713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.824486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41408 (local address 127.0.176.193:38647)
0812 06:17:17.824559 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:17.824561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:17.824571 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:17:17.824619 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:17.824620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:17.824641 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:17.824703 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:17.824893 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.825367 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.826150 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:17.826333 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:17.826393 (+ 60us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:17.826603 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:17.826708 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:17.826786 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:17.826848 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 06:17:17.826866 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 06:17:17.829056 32423 raft_consensus.cc:1261] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383 [term 1 FOLLOWER]: Refusing update from remote peer 8d11b339bf6d4966befbd89dbd6630e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:17.829207 32627 raft_consensus.cc:1261] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7 [term 1 FOLLOWER]: Refusing update from remote peer 8d11b339bf6d4966befbd89dbd6630e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:17.829497 32734 consensus_queue.cc:1035] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146f40bf48ac4e3d9995ea07461c4383" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 45329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:17.829663 32732 consensus_queue.cc:1035] T 7e1cecf77c1540bba9a9314c920c4a27 P 8d11b339bf6d4966befbd89dbd6630e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b333dcfb99af4043a858decc42c4c2d7" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:17.835767 32021 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:17:17.835889 32021 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:17:17.836736 32021 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9aab3f9ab67349aa94cdc8425c8328c9: Sending DeleteTablet for 3 replicas of tablet 7e1cecf77c1540bba9a9314c920c4a27
I20260812 06:17:17.837139 32594 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e1cecf77c1540bba9a9314c920c4a27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:17 UTC) from {username='slave'} at 127.0.0.1:35638
I20260812 06:17:17.837392 32212 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e1cecf77c1540bba9a9314c920c4a27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:17 UTC) from {username='slave'} at 127.0.0.1:41404
I20260812 06:17:17.837415 32756 tablet_replica.cc:330] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7: stopping tablet replica
I20260812 06:17:17.837530 32756 raft_consensus.cc:2229] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:17:17.837639 32756 raft_consensus.cc:2258] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:17.837767 32394 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e1cecf77c1540bba9a9314c920c4a27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:17 UTC) from {username='slave'} at 127.0.0.1:38686
I20260812 06:17:17.837821 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 32106
I20260812 06:17:17.838132 32756 ts_tablet_manager.cc:1905] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:17:17.839690 32756 ts_tablet_manager.cc:1918] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:17:17.839762 32756 log.cc:1196] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/7e1cecf77c1540bba9a9314c920c4a27
I20260812 06:17:17.839996 32756 ts_tablet_manager.cc:1939] T 7e1cecf77c1540bba9a9314c920c4a27 P b333dcfb99af4043a858decc42c4c2d7: Deleting consensus metadata
I20260812 06:17:17.840126 32763 tablet_replica.cc:330] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383: stopping tablet replica
I20260812 06:17:17.840225 32763 raft_consensus.cc:2229] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:17:17.840318 32763 raft_consensus.cc:2258] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:17.845568 32763 ts_tablet_manager.cc:1905] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:17:17.845711 31996 catalog_manager.cc:4841] TS b333dcfb99af4043a858decc42c4c2d7 (127.0.176.195:42055): tablet 7e1cecf77c1540bba9a9314c920c4a27 (table test-table [id=dfa681f613f14d5abe57681ff5da6175]) successfully deleted
I20260812 06:17:17.847961 32763 ts_tablet_manager.cc:1918] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:17:17.848043 32763 log.cc:1196] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/7e1cecf77c1540bba9a9314c920c4a27
I20260812 06:17:17.848279 32763 ts_tablet_manager.cc:1939] T 7e1cecf77c1540bba9a9314c920c4a27 P 146f40bf48ac4e3d9995ea07461c4383: Deleting consensus metadata
I20260812 06:17:17.848714 32000 catalog_manager.cc:4841] TS 146f40bf48ac4e3d9995ea07461c4383 (127.0.176.194:45329): tablet 7e1cecf77c1540bba9a9314c920c4a27 (table test-table [id=dfa681f613f14d5abe57681ff5da6175]) successfully deleted
W20260812 06:17:17.852969 31997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:38647 (error 108)
I20260812 06:17:17.853196 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 32301
I20260812 06:17:17.855974 32708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:17.853381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:38647 (local address 127.0.0.1:41410)
0812 06:17:17.855867 (+ 2486us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:17.855927 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:38647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2456}
W20260812 06:17:17.866679 31997 catalog_manager.cc:4584] TS 8d11b339bf6d4966befbd89dbd6630e3 (127.0.176.193:38647): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7e1cecf77c1540bba9a9314c920c4a27: Network error: Client connection negotiation failed: client connection to 127.0.176.193:38647: connect: Connection refused (error 111)
I20260812 06:17:17.872381 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 32494
I20260812 06:17:17.883327 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 31973
2026-08-12T06:17:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (753 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:17 dist-test-slave-gw5c krb5kdc[301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:17 dist-test-slave-gw5c krb5kdc[301](info): set up 2 sockets
Aug 12 06:17:17 dist-test-slave-gw5c krb5kdc[301](info): commencing operation
krb5kdc: starting...
W20260812 06:17:19.189582 707 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:19 dist-test-slave-gw5c krb5kdc[301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:17:19.330502 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43667
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:38171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:43667
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:19.426107 316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:19.426419 316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:19.426466 316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:19.428736 316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:19.428810 316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:19.428826 316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:19.428839 316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:19.428854 316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:19.430596 316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:38171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:43667
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:19.430819 316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:19.431015 316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:19.436622 325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:19.436856 328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:19.436690 323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:19.436872 316 server_base.cc:1034] running on GCE node
I20260812 06:17:19.437211 316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:19.437566 316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:19.438759 316 hybrid_clock.cc:648] HybridClock initialized: now 1786515439438742 us; error 48 us; skew 500 ppm
Aug 12 06:17:19 dist-test-slave-gw5c krb5kdc[301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515439, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:19.441619 316 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:17:19.442126 316 webserver.cc:460] Webserver started at http://127.0.176.254:35153/ using document root <none> and password file <none>
I20260812 06:17:19.442374 316 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:19.442423 316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:19.442590 316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:19.443835 316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "73da594349514c03937d9bdc4c6f7c72"
format_stamp: "Formatted at 2026-08-12 06:17:19 on dist-test-slave-gw5c"
server_key: "5d9c5353d94b58eec558ff8d9c964180"
server_key_iv: "145126d7ea96436194aef847b8ec053c"
server_key_version: "encryptionkey@0"
I20260812 06:17:19.444221 316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "73da594349514c03937d9bdc4c6f7c72"
format_stamp: "Formatted at 2026-08-12 06:17:19 on dist-test-slave-gw5c"
server_key: "5d9c5353d94b58eec558ff8d9c964180"
server_key_iv: "145126d7ea96436194aef847b8ec053c"
server_key_version: "encryptionkey@0"
I20260812 06:17:19.445674 316 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:17:19.446470 343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:19.446787 316 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:19.446904 316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "73da594349514c03937d9bdc4c6f7c72"
format_stamp: "Formatted at 2026-08-12 06:17:19 on dist-test-slave-gw5c"
server_key: "5d9c5353d94b58eec558ff8d9c964180"
server_key_iv: "145126d7ea96436194aef847b8ec053c"
server_key_version: "encryptionkey@0"
I20260812 06:17:19.447001 316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:19.473613 316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:19.475852 316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:19.476022 316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:19.480433 316 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:43667
I20260812 06:17:19.480516 415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:43667 every 8 connection(s)
I20260812 06:17:19.480906 316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:19.481977 416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:19.484561 416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72: Bootstrap starting.
I20260812 06:17:19.485241 416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:19.485577 416 log.cc:824] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:19.487272 416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72: No bootstrap required, opened a new log
I20260812 06:17:19.487772 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 316
I20260812 06:17:19.487921 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:19.488149 707 external_mini_cluster.cc:1428] Setting key 77b67979f36172c4ef72d5a7b6bc6baa
I20260812 06:17:19.490123 416 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73da594349514c03937d9bdc4c6f7c72" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43667 } }
I20260812 06:17:19.490279 416 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:19.490302 416 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73da594349514c03937d9bdc4c6f7c72, State: Initialized, Role: FOLLOWER
I20260812 06:17:19.490438 416 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73da594349514c03937d9bdc4c6f7c72" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43667 } }
I20260812 06:17:19.490520 416 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:19.490573 416 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:19.490624 416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:19.491564 416 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73da594349514c03937d9bdc4c6f7c72" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43667 } }
I20260812 06:17:19.491694 416 leader_election.cc:302] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73da594349514c03937d9bdc4c6f7c72; no voters:
I20260812 06:17:19.491892 416 leader_election.cc:288] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:19.491966 425 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:19.492165 416 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:19.492241 425 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [term 1 LEADER]: Becoming Leader. State: Replica: 73da594349514c03937d9bdc4c6f7c72, State: Running, Role: LEADER
I20260812 06:17:19.492376 425 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73da594349514c03937d9bdc4c6f7c72" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43667 } }
I20260812 06:17:19.492739 426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73da594349514c03937d9bdc4c6f7c72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73da594349514c03937d9bdc4c6f7c72" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43667 } } }
I20260812 06:17:19.492913 426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:19.492722 425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73da594349514c03937d9bdc4c6f7c72. Latest consensus state: current_term: 1 leader_uuid: "73da594349514c03937d9bdc4c6f7c72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73da594349514c03937d9bdc4c6f7c72" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43667 } } }
I20260812 06:17:19.493043 425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:19.493572 442 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:19.494167 442 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 06:17:19 dist-test-slave-gw5c krb5kdc[301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:19.497421 442 catalog_manager.cc:1347] Generated new cluster ID: a1e377679b8c4b95a5148b4db7d47004
I20260812 06:17:19.497489 442 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:19.502087 424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:19.488734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41966 (local address 127.0.176.254:43667)
0812 06:17:19.488954 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:19.488965 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:19.489006 (+ 41us) server_negotiation.cc:407] Connection header received
0812 06:17:19.489664 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:19.489674 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:19.489745 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:19.489929 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:19.490718 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:19.492488 (+ 1770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:19.493675 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:19.494379 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:19.494497 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:19.498066 (+ 3569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:19.498070 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:19.498071 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:19.498085 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:19.500309 (+ 2224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:19.500760 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:19.500765 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:19.500765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:19.500883 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:19.501095 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:19.501095 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:19.501096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:19.501447 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:19.501616 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:19.501693 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 06:17:19.501859 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":80,"threads_started":1}
I20260812 06:17:19.529392 442 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:19.530172 442 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:19.536911 442 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72: Generated new TSK 0
I20260812 06:17:19.537163 442 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.0.176.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
Entry for principal kudu/127.0.176.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab.
I20260812 06:17:19.574843 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43667
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:38171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:19.666536 464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:19.666831 464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:19.666873 464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:19.668278 464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:19.668367 464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:19.668421 464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:17:19.670042 464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:38171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.193.keytab
--principal=kudu/127.0.176.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:19.670344 464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:19.670601 464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:19.676106 478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:19.676100 472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:19.676100 474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:19.676129 464 server_base.cc:1034] running on GCE node
I20260812 06:17:19.676502 464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:19.676786 464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:19.678010 464 hybrid_clock.cc:648] HybridClock initialized: now 1786515439677978 us; error 40 us; skew 500 ppm
Aug 12 06:17:19 dist-test-slave-gw5c krb5kdc[301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515439, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:19.681421 464 init.cc:377] Logged in from keytab as kudu/127.0.176.193@KRBTEST.COM (short username kudu)
I20260812 06:17:19.681981 464 webserver.cc:460] Webserver started at http://127.0.176.193:45179/ using document root <none> and password file <none>
I20260812 06:17:19.682240 464 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:19.682288 464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:19.682443 464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:19.683655 464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "b7ee04d3a1f74905ab550ce8f94be1df"
format_stamp: "Formatted at 2026-08-12 06:17:19 on dist-test-slave-gw5c"
server_key: "b800a73a73188fe13ad51036d904b7f7"
server_key_iv: "95f201e9f324b7b085922a2549baaba8"
server_key_version: "encryptionkey@0"
I20260812 06:17:19.684034 464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "b7ee04d3a1f74905ab550ce8f94be1df"
format_stamp: "Formatted at 2026-08-12 06:17:19 on dist-test-slave-gw5c"
server_key: "b800a73a73188fe13ad51036d904b7f7"
server_key_iv: "95f201e9f324b7b085922a2549baaba8"
server_key_version: "encryptionkey@0"
I20260812 06:17:19.685460 464 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:17:19.686317 486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:19.686547 464 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:19.686656 464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "b7ee04d3a1f74905ab550ce8f94be1df"
format_stamp: "Formatted at 2026-08-12 06:17:19 on dist-test-slave-gw5c"
server_key: "b800a73a73188fe13ad51036d904b7f7"
server_key_iv: "95f201e9f324b7b085922a2549baaba8"
server_key_version: "encryptionkey@0"
I20260812 06:17:19.686730 464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:19.695137 464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:19.697870 464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:19.698046 464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:19.698309 464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:19.698659 464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:19.698696 464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:19.698719 464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:19.698766 464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:19.705348 464 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:44881
I20260812 06:17:19.705433 661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:44881 every 8 connection(s)
I20260812 06:17:19.705806 464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:17:19.712086 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 464
I20260812 06:17:19.712203 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:17:19.712455 707 external_mini_cluster.cc:1428] Setting key 922a8d105932a5cb10ff3a1cf32e9ddd
Aug 12 06:17:19 dist-test-slave-gw5c krb5kdc[301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515439, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.193@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:19.718158 424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:19.706738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:56155 (local address 127.0.176.254:43667)
0812 06:17:19.706820 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:19.706823 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:19.707201 (+ 378us) server_negotiation.cc:407] Connection header received
0812 06:17:19.708337 (+ 1136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:19.708339 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:19.708351 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:19.708418 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:19.709191 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:19.709721 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:19.710858 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:19.711086 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:19.711158 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:19.714076 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:19.714078 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:19.714078 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:19.714088 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:19.715897 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:19.716550 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:19.716551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:19.716551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:19.716618 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:19.717021 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:19.717024 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:19.717024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:19.717257 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:19.717433 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:19.717903 (+ 470us) server_negotiation.cc:299] Negotiation successful
0812 06:17:19.718048 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 06:17:19.718333 665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:19.706714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43667 (local address 127.0.176.193:56155)
0812 06:17:19.707015 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:19.707064 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:19.708174 (+ 1110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:19.708523 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:19.708526 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:19.708839 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:19.709061 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:19.709065 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:19.709848 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:19.709849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:19.710737 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:19.710740 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:19.711211 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:19.711212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:19.711344 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:19.712052 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:19.712062 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:19.713973 (+ 1911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:19.716004 (+ 2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:19.716028 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:19.716031 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:19.716436 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:19.716700 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:19.716700 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:19.716701 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:19.716869 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:19.717426 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:19.717447 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:19.717697 (+ 250us) client_negotiation.cc:769] Sending connection context
0812 06:17:19.717867 (+ 170us) client_negotiation.cc:240] Negotiation successful
0812 06:17:19.718069 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":159,"threads_started":1}
I20260812 06:17:19.719086 662 heartbeater.cc:347] Connected to a master server at 127.0.176.254:43667
I20260812 06:17:19.719228 662 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:19.719496 662 heartbeater.cc:511] Master 127.0.176.254:43667 requested a full tablet report, sending...
I20260812 06:17:19.720382 365 ts_manager.cc:194] Registered new tserver with Master: b7ee04d3a1f74905ab550ce8f94be1df (127.0.176.193:44881)
I20260812 06:17:19.721095 365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.193@KRBTEST.COM'} at 127.0.176.193:56155
WARNING: no policy specified for kudu/127.0.176.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
Entry for principal kudu/127.0.176.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab.
I20260812 06:17:19.742578 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43667
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:38171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:19.831883 668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:19.832177 668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:19.832223 668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:19.833474 668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:19.833555 668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:19.833606 668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:17:19.835268 668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:38171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.194.keytab
--principal=kudu/127.0.176.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:19.835616 668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:19.835883 668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:19.841233 678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:19.841221 674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:19.841221 676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:19.841656 668 server_base.cc:1034] running on GCE node
I20260812 06:17:19.841912 668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:19.842168 668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:19.843359 668 hybrid_clock.cc:648] HybridClock initialized: now 1786515439843343 us; error 31 us; skew 500 ppm
Aug 12 06:17:19 dist-test-slave-gw5c krb5kdc[301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515439, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:19.846086 668 init.cc:377] Logged in from keytab as kudu/127.0.176.194@KRBTEST.COM (short username kudu)
I20260812 06:17:19.846565 668 webserver.cc:460] Webserver started at http://127.0.176.194:34077/ using document root <none> and password file <none>
I20260812 06:17:19.846809 668 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:19.846882 668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:19.847046 668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:19.848229 668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "63588ca841ab4dc1bdc1e625fb889c70"
format_stamp: "Formatted at 2026-08-12 06:17:19 on dist-test-slave-gw5c"
server_key: "3637e035605010a6322d05516a46ccec"
server_key_iv: "575136db21a590feaec8ab7532436fca"
server_key_version: "encryptionkey@0"
I20260812 06:17:19.848620 668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "63588ca841ab4dc1bdc1e625fb889c70"
format_stamp: "Formatted at 2026-08-12 06:17:19 on dist-test-slave-gw5c"
server_key: "3637e035605010a6322d05516a46ccec"
server_key_iv: "575136db21a590feaec8ab7532436fca"
server_key_version: "encryptionkey@0"
I20260812 06:17:19.850111 668 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:17:19.850910 690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:19.851079 668 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:17:19.851191 668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "63588ca841ab4dc1bdc1e625fb889c70"
format_stamp: "Formatted at 2026-08-12 06:17:19 on dist-test-slave-gw5c"
server_key: "3637e035605010a6322d05516a46ccec"
server_key_iv: "575136db21a590feaec8ab7532436fca"
server_key_version: "encryptionkey@0"
I20260812 06:17:19.851281 668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:19.865204 668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:19.868199 668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:19.868394 668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:19.868660 668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:19.869010 668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:19.869066 668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:19.869112 668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:19.869138 668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:19.875275 668 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:39495
I20260812 06:17:19.875365 861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:39495 every 8 connection(s)
I20260812 06:17:19.875771 668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:17:19.879457 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 668
I20260812 06:17:19.879599 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:17:19.879827 707 external_mini_cluster.cc:1428] Setting key 1c1dca1f4a7a3a8c18072f7b406ce6c6
Aug 12 06:17:19 dist-test-slave-gw5c krb5kdc[301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515439, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.194@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:19.887189 424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:19.876657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:39079 (local address 127.0.176.254:43667)
0812 06:17:19.876757 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:19.876791 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:19.877000 (+ 209us) server_negotiation.cc:407] Connection header received
0812 06:17:19.878072 (+ 1072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:19.878073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:19.878087 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:19.878141 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:19.878842 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:19.879371 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:19.880701 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:19.880911 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:19.881001 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:19.883464 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:19.883466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:19.883466 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:19.883475 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:19.885397 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:19.886111 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:19.886113 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:19.886113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:19.886183 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:19.886484 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:19.886485 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:19.886485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:19.886615 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:19.886697 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:19.887003 (+ 306us) server_negotiation.cc:299] Negotiation successful
0812 06:17:19.887095 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 06:17:19.887440 866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:19.876639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43667 (local address 127.0.176.194:39079)
0812 06:17:19.876869 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:19.876910 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:19.877937 (+ 1027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:19.878220 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:19.878225 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:19.878526 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:19.878732 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:19.878736 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:19.879534 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:19.879536 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:19.880607 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:19.880610 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:19.881016 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:19.881017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:19.881145 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:19.881767 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:19.881776 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:19.883326 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:19.885498 (+ 2172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:19.885510 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:19.885513 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:19.885979 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:19.886270 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:19.886271 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:19.886272 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:19.886406 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:19.886686 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:19.886694 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:19.886849 (+ 155us) client_negotiation.cc:769] Sending connection context
0812 06:17:19.886959 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 06:17:19.887141 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":105,"threads_started":1}
I20260812 06:17:19.888055 864 heartbeater.cc:347] Connected to a master server at 127.0.176.254:43667
I20260812 06:17:19.888159 864 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:19.888379 864 heartbeater.cc:511] Master 127.0.176.254:43667 requested a full tablet report, sending...
I20260812 06:17:19.888798 365 ts_manager.cc:194] Registered new tserver with Master: 63588ca841ab4dc1bdc1e625fb889c70 (127.0.176.194:39495)
WARNING: no policy specified for kudu/127.0.176.195@KRBTEST.COM; defaulting to no policy
I20260812 06:17:19.889204 365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.194@KRBTEST.COM'} at 127.0.176.194:39079
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
Entry for principal kudu/127.0.176.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab.
I20260812 06:17:19.906718 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43667
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:38171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:19.992265 873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:19.992496 873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:19.992552 873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:19.993955 873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:19.994009 873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:19.994040 873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:17:19.995787 873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:38171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/krb5kdc/kudu_127.0.176.195.keytab
--principal=kudu/127.0.176.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:43667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:19.996090 873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:19.996344 873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:20.001619 880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:20.001643 881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:20.001852 883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:20.001976 873 server_base.cc:1034] running on GCE node
I20260812 06:17:20.002480 873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:20.002796 873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:20.003969 873 hybrid_clock.cc:648] HybridClock initialized: now 1786515440003929 us; error 51 us; skew 500 ppm
Aug 12 06:17:20 dist-test-slave-gw5c krb5kdc[301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515440, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:20.006770 873 init.cc:377] Logged in from keytab as kudu/127.0.176.195@KRBTEST.COM (short username kudu)
I20260812 06:17:20.007313 873 webserver.cc:460] Webserver started at http://127.0.176.195:42217/ using document root <none> and password file <none>
I20260812 06:17:20.007602 873 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:20.007676 873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:20.007838 873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:20.008944 873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "b3a8c7ab034148c2959b1ac4f88e6587"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "c036483e6772116f89bd04c24111d4b0"
server_key_iv: "a1ca8f690491a1142e1b250d8099008d"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.009325 873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "b3a8c7ab034148c2959b1ac4f88e6587"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "c036483e6772116f89bd04c24111d4b0"
server_key_iv: "a1ca8f690491a1142e1b250d8099008d"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.010756 873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:17:20.011569 895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:20.011767 873 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:20.011878 873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "b3a8c7ab034148c2959b1ac4f88e6587"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "c036483e6772116f89bd04c24111d4b0"
server_key_iv: "a1ca8f690491a1142e1b250d8099008d"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.011969 873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:20.042886 873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:20.044955 873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:20.045130 873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:20.045383 873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:20.045715 873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:20.045773 873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:20.045819 873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:20.045857 873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:20.052502 873 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:36259
I20260812 06:17:20.052558 1071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:36259 every 8 connection(s)
I20260812 06:17:20.052966 873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:17:20 dist-test-slave-gw5c krb5kdc[301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515440, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.195@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:20.063117 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 873
I20260812 06:17:20.063274 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:17:20.063545 707 external_mini_cluster.cc:1428] Setting key ea1c62144d583b45a3972ee86b3bfe9a
I20260812 06:17:20.064705 424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.053789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:53023 (local address 127.0.176.254:43667)
0812 06:17:20.053840 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.053842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.054020 (+ 178us) server_negotiation.cc:407] Connection header received
0812 06:17:20.055028 (+ 1008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.055029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.055067 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.055213 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:20.056030 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.056557 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.057878 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.058182 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.058261 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.061270 (+ 3009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:20.061272 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:20.061272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:20.061281 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:20.062923 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:20.063485 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:20.063487 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:20.063487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:20.063552 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:20.063865 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:20.063866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:20.063867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:20.064017 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:20.064097 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.064419 (+ 322us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.064519 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:17:20.064951 1075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.053700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:43667 (local address 127.0.176.195:53023)
0812 06:17:20.053875 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.053919 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.054910 (+ 991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.055334 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.055343 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.055697 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:20.055910 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.055914 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.056661 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.056662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.057774 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.057796 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.058273 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.058274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.058432 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.059113 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:20.059124 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:20.061114 (+ 1990us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:20.063051 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:20.063061 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:20.063064 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:20.063392 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:20.063643 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:20.063644 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:20.063645 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:20.063786 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:20.064100 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:20.064109 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:20.064271 (+ 162us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.064380 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.064566 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":110,"threads_started":1}
I20260812 06:17:20.065438 1072 heartbeater.cc:347] Connected to a master server at 127.0.176.254:43667
I20260812 06:17:20.065536 1072 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:20.065788 1072 heartbeater.cc:511] Master 127.0.176.254:43667 requested a full tablet report, sending...
I20260812 06:17:20.066207 365 ts_manager.cc:194] Registered new tserver with Master: b3a8c7ab034148c2959b1ac4f88e6587 (127.0.176.195:36259)
I20260812 06:17:20.066605 365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.0.176.195@KRBTEST.COM'} at 127.0.176.195:53023
I20260812 06:17:20.075799 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:17:20.083737 424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.077388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41972 (local address 127.0.176.254:43667)
0812 06:17:20.077484 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.077487 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.077584 (+ 97us) server_negotiation.cc:407] Connection header received
0812 06:17:20.077676 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.077677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.077688 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.077736 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:20.078341 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.078882 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.079693 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.079911 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.080000 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.081263 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:20.081264 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:20.081265 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:20.081272 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:20.082469 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:20.082831 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:20.082832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:20.082833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:20.082895 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:20.083111 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:20.083112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:20.083112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:20.083280 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:20.083390 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.083542 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.083630 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 06:17:20.085279 365 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41972:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:17:20.086854 365 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:17:20.093951 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.089221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:39495 (local address 127.0.0.1:37392)
0812 06:17:20.089406 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.089452 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.089529 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.089826 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.089829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.089832 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:20.089951 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.089953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.091357 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.091358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.092985 (+ 1627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.092987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.093709 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.093710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.093761 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.093764 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.093817 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.093854 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":43,"thread_start_us":74,"threads_started":1}
I20260812 06:17:20.094174 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.089452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44881 (local address 127.0.0.1:51892)
0812 06:17:20.089838 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.089848 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.089929 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.090214 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.090215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.090217 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:20.090293 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.090295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.091525 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.091526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.092581 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.092584 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.093574 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.093575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.093659 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.093678 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.093751 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.093820 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":89,"threads_started":1}
I20260812 06:17:20.094264 1096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.089623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58098 (local address 127.0.176.195:36259)
0812 06:17:20.089826 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.089830 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.089946 (+ 116us) server_negotiation.cc:407] Connection header received
0812 06:17:20.089997 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.090000 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.090017 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.090088 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:20.090306 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.091148 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.092762 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.093476 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.093556 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.093618 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.094119 (+ 501us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.094169 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":93,"threads_started":1}
I20260812 06:17:20.093951 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.089254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:36259 (local address 127.0.0.1:58098)
0812 06:17:20.089827 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.089837 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.089888 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.090178 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.090179 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.090181 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:20.090217 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.090218 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.091261 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.091262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.092691 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.092693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.093658 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.093659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.093745 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.093749 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.093804 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.093864 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"mutex_wait_us":49,"thread_start_us":103,"threads_started":1}
I20260812 06:17:20.094084 1093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.089596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51892 (local address 127.0.176.193:44881)
0812 06:17:20.089769 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.089775 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.089901 (+ 126us) server_negotiation.cc:407] Connection header received
0812 06:17:20.090030 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.090032 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.090048 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.090104 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:20.090357 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.091422 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.092674 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.093476 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.093556 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.093619 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.093961 (+ 342us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.094007 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":92,"threads_started":1}
I20260812 06:17:20.094007 1091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.089377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37392 (local address 127.0.176.194:39495)
0812 06:17:20.089619 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.089624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.089636 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:17:20.089680 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.089683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.089701 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.090037 (+ 336us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:20.090126 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.091242 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.093066 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.093636 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.093714 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.093775 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.093833 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.093877 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":112,"threads_started":1}
I20260812 06:17:20.095119 555 tablet_service.cc:1467] Processing CreateTablet for tablet d1ac9c3f99dc4df4a7e80a95af263acd (DEFAULT_TABLE table=test-table [id=73c3976827c346c8b8c82c846ec8a3b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:20.095119 967 tablet_service.cc:1467] Processing CreateTablet for tablet d1ac9c3f99dc4df4a7e80a95af263acd (DEFAULT_TABLE table=test-table [id=73c3976827c346c8b8c82c846ec8a3b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:20.095551 555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1ac9c3f99dc4df4a7e80a95af263acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:20.095551 967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1ac9c3f99dc4df4a7e80a95af263acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:20.095561 765 tablet_service.cc:1467] Processing CreateTablet for tablet d1ac9c3f99dc4df4a7e80a95af263acd (DEFAULT_TABLE table=test-table [id=73c3976827c346c8b8c82c846ec8a3b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:20.095945 765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1ac9c3f99dc4df4a7e80a95af263acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:20.098897 1097 tablet_bootstrap.cc:492] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70: Bootstrap starting.
I20260812 06:17:20.099130 1098 tablet_bootstrap.cc:492] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587: Bootstrap starting.
I20260812 06:17:20.099570 1100 tablet_bootstrap.cc:492] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df: Bootstrap starting.
I20260812 06:17:20.099799 1098 tablet_bootstrap.cc:654] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:20.099798 1097 tablet_bootstrap.cc:654] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:20.100183 1100 tablet_bootstrap.cc:654] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:20.100472 1098 log.cc:824] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:20.100502 1097 log.cc:824] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:20.100783 1100 log.cc:824] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:20.101347 1098 tablet_bootstrap.cc:492] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587: No bootstrap required, opened a new log
I20260812 06:17:20.101442 1098 ts_tablet_manager.cc:1397] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:17:20.101562 1097 tablet_bootstrap.cc:492] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70: No bootstrap required, opened a new log
I20260812 06:17:20.101589 1100 tablet_bootstrap.cc:492] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df: No bootstrap required, opened a new log
I20260812 06:17:20.101641 1100 ts_tablet_manager.cc:1397] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:17:20.101656 1097 ts_tablet_manager.cc:1397] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:17:20.103041 1097 raft_consensus.cc:348] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63588ca841ab4dc1bdc1e625fb889c70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39495 } } peers { permanent_uuid: "b7ee04d3a1f74905ab550ce8f94be1df" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44881 } } peers { permanent_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36259 } }
I20260812 06:17:20.103216 1097 raft_consensus.cc:374] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:20.103263 1097 raft_consensus.cc:729] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63588ca841ab4dc1bdc1e625fb889c70, State: Initialized, Role: FOLLOWER
I20260812 06:17:20.103379 1097 consensus_queue.cc:260] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63588ca841ab4dc1bdc1e625fb889c70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39495 } } peers { permanent_uuid: "b7ee04d3a1f74905ab550ce8f94be1df" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44881 } } peers { permanent_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36259 } }
I20260812 06:17:20.103552 1098 raft_consensus.cc:348] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63588ca841ab4dc1bdc1e625fb889c70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39495 } } peers { permanent_uuid: "b7ee04d3a1f74905ab550ce8f94be1df" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44881 } } peers { permanent_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36259 } }
I20260812 06:17:20.103688 864 heartbeater.cc:503] Master 127.0.176.254:43667 was elected leader, sending a full tablet report...
I20260812 06:17:20.103731 1098 raft_consensus.cc:374] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:20.103649 1100 raft_consensus.cc:348] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63588ca841ab4dc1bdc1e625fb889c70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39495 } } peers { permanent_uuid: "b7ee04d3a1f74905ab550ce8f94be1df" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44881 } } peers { permanent_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36259 } }
I20260812 06:17:20.103778 1098 raft_consensus.cc:729] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a8c7ab034148c2959b1ac4f88e6587, State: Initialized, Role: FOLLOWER
I20260812 06:17:20.103695 1097 ts_tablet_manager.cc:1428] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:17:20.103817 1100 raft_consensus.cc:374] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:20.103896 1100 raft_consensus.cc:729] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ee04d3a1f74905ab550ce8f94be1df, State: Initialized, Role: FOLLOWER
I20260812 06:17:20.103896 1098 consensus_queue.cc:260] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63588ca841ab4dc1bdc1e625fb889c70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39495 } } peers { permanent_uuid: "b7ee04d3a1f74905ab550ce8f94be1df" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44881 } } peers { permanent_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36259 } }
I20260812 06:17:20.104033 1100 consensus_queue.cc:260] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63588ca841ab4dc1bdc1e625fb889c70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39495 } } peers { permanent_uuid: "b7ee04d3a1f74905ab550ce8f94be1df" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44881 } } peers { permanent_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36259 } }
I20260812 06:17:20.104190 1098 ts_tablet_manager.cc:1428] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:17:20.104313 1072 heartbeater.cc:503] Master 127.0.176.254:43667 was elected leader, sending a full tablet report...
I20260812 06:17:20.104314 1100 ts_tablet_manager.cc:1428] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:17:20.104363 662 heartbeater.cc:503] Master 127.0.176.254:43667 was elected leader, sending a full tablet report...
W20260812 06:17:20.126396 865 tablet.cc:2369] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:17:20.166455 1107 raft_consensus.cc:482] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:17:20.166610 1107 raft_consensus.cc:504] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63588ca841ab4dc1bdc1e625fb889c70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39495 } } peers { permanent_uuid: "b7ee04d3a1f74905ab550ce8f94be1df" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44881 } } peers { permanent_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36259 } }
I20260812 06:17:20.166930 1107 leader_election.cc:288] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63588ca841ab4dc1bdc1e625fb889c70 (127.0.176.194:39495), b7ee04d3a1f74905ab550ce8f94be1df (127.0.176.193:44881)
I20260812 06:17:20.170756 1075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.167204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:39495 (local address 127.0.176.195:58883)
0812 06:17:20.167293 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.167309 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.167373 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.167590 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.167591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.167592 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:20.167682 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.167685 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.168482 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.168483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.169682 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.169685 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.170462 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.170463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.170549 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.170552 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.170612 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.170661 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 06:17:20.170814 1093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.167495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:41897 (local address 127.0.176.193:44881)
0812 06:17:20.167554 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.167556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.167712 (+ 156us) server_negotiation.cc:407] Connection header received
0812 06:17:20.167741 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.167742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.167755 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.167806 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:20.167977 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.168632 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.169898 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.170472 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.170544 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.170550 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.170706 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.170753 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:17:20.170809 1091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.167317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:58883 (local address 127.0.176.194:39495)
0812 06:17:20.167368 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.167370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.167381 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:17:20.167450 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.167451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.167464 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.167544 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:20.167776 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.168352 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.169782 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.170379 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.170462 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.170472 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.170684 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.170735 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:17:20.170768 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.167351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44881 (local address 127.0.176.195:41897)
0812 06:17:20.167594 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.167617 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.167676 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.167831 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.167831 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.167833 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:20.167902 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.167904 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.168718 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.168719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.169809 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.169811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.170550 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.170551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.170624 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.170626 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.170676 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.170704 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":176,"threads_started":1}
I20260812 06:17:20.171296 588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1ac9c3f99dc4df4a7e80a95af263acd" candidate_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ee04d3a1f74905ab550ce8f94be1df" is_pre_election: true
I20260812 06:17:20.171289 791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1ac9c3f99dc4df4a7e80a95af263acd" candidate_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63588ca841ab4dc1bdc1e625fb889c70" is_pre_election: true
I20260812 06:17:20.171500 791 raft_consensus.cc:2454] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a8c7ab034148c2959b1ac4f88e6587 in term 0.
I20260812 06:17:20.171511 588 raft_consensus.cc:2454] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a8c7ab034148c2959b1ac4f88e6587 in term 0.
I20260812 06:17:20.171793 898 leader_election.cc:302] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63588ca841ab4dc1bdc1e625fb889c70, b3a8c7ab034148c2959b1ac4f88e6587; no voters:
I20260812 06:17:20.171959 1107 raft_consensus.cc:2781] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:17:20.172053 1107 raft_consensus.cc:482] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:17:20.172083 1107 raft_consensus.cc:3037] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:20.172848 1107 raft_consensus.cc:504] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63588ca841ab4dc1bdc1e625fb889c70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39495 } } peers { permanent_uuid: "b7ee04d3a1f74905ab550ce8f94be1df" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44881 } } peers { permanent_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36259 } }
I20260812 06:17:20.173010 1107 leader_election.cc:288] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [CANDIDATE]: Term 1 election: Requested vote from peers 63588ca841ab4dc1bdc1e625fb889c70 (127.0.176.194:39495), b7ee04d3a1f74905ab550ce8f94be1df (127.0.176.193:44881)
I20260812 06:17:20.173208 791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1ac9c3f99dc4df4a7e80a95af263acd" candidate_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63588ca841ab4dc1bdc1e625fb889c70"
I20260812 06:17:20.173243 588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1ac9c3f99dc4df4a7e80a95af263acd" candidate_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ee04d3a1f74905ab550ce8f94be1df"
I20260812 06:17:20.173291 791 raft_consensus.cc:3037] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:20.173329 588 raft_consensus.cc:3037] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:20.174026 588 raft_consensus.cc:2454] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a8c7ab034148c2959b1ac4f88e6587 in term 1.
I20260812 06:17:20.174104 791 raft_consensus.cc:2454] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a8c7ab034148c2959b1ac4f88e6587 in term 1.
I20260812 06:17:20.174263 898 leader_election.cc:302] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3a8c7ab034148c2959b1ac4f88e6587, b7ee04d3a1f74905ab550ce8f94be1df; no voters:
I20260812 06:17:20.174386 1107 raft_consensus.cc:2781] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:20.174575 1107 raft_consensus.cc:686] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [term 1 LEADER]: Becoming Leader. State: Replica: b3a8c7ab034148c2959b1ac4f88e6587, State: Running, Role: LEADER
I20260812 06:17:20.174705 1107 consensus_queue.cc:237] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63588ca841ab4dc1bdc1e625fb889c70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39495 } } peers { permanent_uuid: "b7ee04d3a1f74905ab550ce8f94be1df" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44881 } } peers { permanent_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36259 } }
I20260812 06:17:20.175662 362 catalog_manager.cc:5495] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3a8c7ab034148c2959b1ac4f88e6587 (127.0.176.195). New cstate: current_term: 1 leader_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63588ca841ab4dc1bdc1e625fb889c70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ee04d3a1f74905ab550ce8f94be1df" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3a8c7ab034148c2959b1ac4f88e6587" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260812 06:17:20.186785 1096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.184617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58110 (local address 127.0.176.195:36259)
0812 06:17:20.184688 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.184691 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.184699 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:17:20.184734 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.184735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.184752 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.184814 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:20.184947 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.185403 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.186119 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.186307 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.186358 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.186490 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:20.186592 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:20.186655 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.186684 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.186701 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 06:17:20.189138 791 raft_consensus.cc:1261] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70 [term 1 FOLLOWER]: Refusing update from remote peer b3a8c7ab034148c2959b1ac4f88e6587: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:20.189162 588 raft_consensus.cc:1261] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df [term 1 FOLLOWER]: Refusing update from remote peer b3a8c7ab034148c2959b1ac4f88e6587: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:20.189585 1110 consensus_queue.cc:1035] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63588ca841ab4dc1bdc1e625fb889c70" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 39495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:20.189749 1107 consensus_queue.cc:1035] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ee04d3a1f74905ab550ce8f94be1df" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 44881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:20.195058 362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41972:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:17:20.195178 362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41972:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:17:20.196019 362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73da594349514c03937d9bdc4c6f7c72: Sending DeleteTablet for 3 replicas of tablet d1ac9c3f99dc4df4a7e80a95af263acd
I20260812 06:17:20.196396 555 tablet_service.cc:1514] Processing DeleteTablet for tablet d1ac9c3f99dc4df4a7e80a95af263acd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:20 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:51892
I20260812 06:17:20.196388 765 tablet_service.cc:1514] Processing DeleteTablet for tablet d1ac9c3f99dc4df4a7e80a95af263acd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:20 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:37392
I20260812 06:17:20.196645 1127 tablet_replica.cc:330] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df: stopping tablet replica
I20260812 06:17:20.196667 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 464
I20260812 06:17:20.196754 1127 raft_consensus.cc:2229] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:17:20.196858 1127 raft_consensus.cc:2258] T d1ac9c3f99dc4df4a7e80a95af263acd P b7ee04d3a1f74905ab550ce8f94be1df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:20.202607 1126 tablet_replica.cc:330] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70: stopping tablet replica
I20260812 06:17:20.202750 1126 raft_consensus.cc:2229] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:17:20.202867 1126 raft_consensus.cc:2258] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:20.205706 967 tablet_service.cc:1514] Processing DeleteTablet for tablet d1ac9c3f99dc4df4a7e80a95af263acd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:20 UTC) from {username='kudu', principal='kudu/127.0.176.254@KRBTEST.COM'} at 127.0.0.1:58098
I20260812 06:17:20.205927 1126 ts_tablet_manager.cc:1905] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:17:20.206044 1128 tablet_replica.cc:330] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587: stopping tablet replica
I20260812 06:17:20.206265 1128 raft_consensus.cc:2229] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:17:20.206548 1128 raft_consensus.cc:2258] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:20.207860 1126 ts_tablet_manager.cc:1918] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:17:20.208015 1126 log.cc:1196] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/d1ac9c3f99dc4df4a7e80a95af263acd
I20260812 06:17:20.208421 1126 ts_tablet_manager.cc:1939] T d1ac9c3f99dc4df4a7e80a95af263acd P 63588ca841ab4dc1bdc1e625fb889c70: Deleting consensus metadata
I20260812 06:17:20.209030 345 catalog_manager.cc:4841] TS 63588ca841ab4dc1bdc1e625fb889c70 (127.0.176.194:39495): tablet d1ac9c3f99dc4df4a7e80a95af263acd (table test-table [id=73c3976827c346c8b8c82c846ec8a3b0]) successfully deleted
I20260812 06:17:20.209728 1128 ts_tablet_manager.cc:1905] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:17:20.212111 1128 ts_tablet_manager.cc:1918] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:17:20.212222 1128 log.cc:1196] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/d1ac9c3f99dc4df4a7e80a95af263acd
I20260812 06:17:20.212500 1128 ts_tablet_manager.cc:1939] T d1ac9c3f99dc4df4a7e80a95af263acd P b3a8c7ab034148c2959b1ac4f88e6587: Deleting consensus metadata
I20260812 06:17:20.212946 346 catalog_manager.cc:4841] TS b3a8c7ab034148c2959b1ac4f88e6587 (127.0.176.195:36259): tablet d1ac9c3f99dc4df4a7e80a95af263acd (table test-table [id=73c3976827c346c8b8c82c846ec8a3b0]) successfully deleted
W20260812 06:17:20.226413 345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:44881 (error 108)
I20260812 06:17:20.226614 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 668
I20260812 06:17:20.227022 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.226883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:44881 (local address 127.0.0.1:51896)
0812 06:17:20.226944 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.226979 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:44881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 06:17:20.227129 345 catalog_manager.cc:4584] TS b7ee04d3a1f74905ab550ce8f94be1df (127.0.176.193:44881): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d1ac9c3f99dc4df4a7e80a95af263acd: Network error: Client connection negotiation failed: client connection to 127.0.176.193:44881: connect: Connection refused (error 111)
I20260812 06:17:20.240468 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 873
I20260812 06:17:20.248114 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 316
2026-08-12T06:17:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2364 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T06:17:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:20Z Disabled control of system clock
I20260812 06:17:20.287106 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:33333
--webserver_interface=127.0.176.254
--webserver_port=0
--builtin_ntp_servers=127.0.176.212:41171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:33333
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:17:20.375258 1135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:20.375555 1135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:20.375581 1135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:20.376781 1135 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:20.376822 1135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:20.376835 1135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:20.376847 1135 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:20.376859 1135 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:20.378187 1135 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:41171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:33333
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:33333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1135
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:20.378512 1135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:20.378989 1135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:20.384121 1141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:20.384186 1143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:20.384418 1146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:20.384865 1135 server_base.cc:1034] running on GCE node
I20260812 06:17:20.385169 1135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:20.385500 1135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:20.386698 1135 hybrid_clock.cc:648] HybridClock initialized: now 1786515440386693 us; error 40 us; skew 500 ppm
I20260812 06:17:20.388074 1135 webserver.cc:460] Webserver started at http://127.0.176.254:38767/ using document root <none> and password file <none>
I20260812 06:17:20.388332 1135 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:20.388415 1135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:20.388572 1135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:20.389686 1135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "94e206d757444743bb3625b144e8a100"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "474258526aeb5454bfb6a9a056dbc263"
server_key_iv: "185b59b3aef0d991622aa352fa861350"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.390064 1135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "94e206d757444743bb3625b144e8a100"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "474258526aeb5454bfb6a9a056dbc263"
server_key_iv: "185b59b3aef0d991622aa352fa861350"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.391451 1135 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:17:20.392216 1154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:20.392392 1135 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:17:20.392509 1135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "94e206d757444743bb3625b144e8a100"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "474258526aeb5454bfb6a9a056dbc263"
server_key_iv: "185b59b3aef0d991622aa352fa861350"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.392592 1135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:20.414175 1135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:20.414562 1135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:20.414732 1135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:20.419086 1135 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:33333
I20260812 06:17:20.419170 1237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:33333 every 8 connection(s)
I20260812 06:17:20.419543 1135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:20.420611 1238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:20.423070 1238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100: Bootstrap starting.
I20260812 06:17:20.423094 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 1135
I20260812 06:17:20.423239 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:20.423509 707 external_mini_cluster.cc:1428] Setting key 6d68727840c17e7e959c838a7cf1e849
I20260812 06:17:20.423966 1238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:20.424340 1238 log.cc:824] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:20.425118 1238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100: No bootstrap required, opened a new log
I20260812 06:17:20.427410 1238 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94e206d757444743bb3625b144e8a100" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 33333 } }
I20260812 06:17:20.427592 1238 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:20.427625 1238 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94e206d757444743bb3625b144e8a100, State: Initialized, Role: FOLLOWER
I20260812 06:17:20.427752 1238 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94e206d757444743bb3625b144e8a100" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 33333 } }
I20260812 06:17:20.427845 1238 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:20.427870 1238 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:20.427953 1238 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:20.428634 1238 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94e206d757444743bb3625b144e8a100" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 33333 } }
I20260812 06:17:20.428757 1238 leader_election.cc:302] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94e206d757444743bb3625b144e8a100; no voters:
I20260812 06:17:20.428995 1238 leader_election.cc:288] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:20.429126 1244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:20.429272 1244 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [term 1 LEADER]: Becoming Leader. State: Replica: 94e206d757444743bb3625b144e8a100, State: Running, Role: LEADER
I20260812 06:17:20.429356 1238 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:20.429355 1244 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94e206d757444743bb3625b144e8a100" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 33333 } }
I20260812 06:17:20.430123 1242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.424233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38380 (local address 127.0.176.254:33333)
0812 06:17:20.424596 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.424606 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.424646 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:17:20.425167 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.425174 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.425293 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.425433 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:20.425706 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.426634 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.427819 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.428338 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.428432 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.429205 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:20.429209 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:20.429210 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:20.429453 (+ 243us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:20.429495 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:20.429509 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:20.429578 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.429779 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.429870 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":119,"threads_started":1}
I20260812 06:17:20.431114 1245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94e206d757444743bb3625b144e8a100. Latest consensus state: current_term: 1 leader_uuid: "94e206d757444743bb3625b144e8a100" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94e206d757444743bb3625b144e8a100" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 33333 } } }
I20260812 06:17:20.431224 1245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:20.431485 1246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94e206d757444743bb3625b144e8a100" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94e206d757444743bb3625b144e8a100" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 33333 } } }
I20260812 06:17:20.431546 1246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:20.431682 1259 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:20.432113 1259 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:20.433632 1259 catalog_manager.cc:1347] Generated new cluster ID: 463c4393f8b64745b4cd217b2d8b99e7
I20260812 06:17:20.433687 1259 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:20.444769 1259 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:20.445300 1259 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:20.447572 1259 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100: Generated new TSK 0
I20260812 06:17:20.447769 1259 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:20.451267 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.193:0
--local_ip_for_outbound_sockets=127.0.176.193
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:33333
--builtin_ntp_servers=127.0.176.212:41171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:17:20.538298 1270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:20.538527 1270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:20.538551 1270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:20.539803 1270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:20.539856 1270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:20.539883 1270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.193
I20260812 06:17:20.541298 1270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:41171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.176.193
--webserver_port=0
--tserver_master_addrs=127.0.176.254:33333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.193
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:20.541585 1270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:20.541934 1270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:20.547916 1277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:20.547928 1284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:20.547923 1279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:20.548502 1270 server_base.cc:1034] running on GCE node
I20260812 06:17:20.548743 1270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:20.549014 1270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:20.550211 1270 hybrid_clock.cc:648] HybridClock initialized: now 1786515440550195 us; error 31 us; skew 500 ppm
I20260812 06:17:20.551710 1270 webserver.cc:460] Webserver started at http://127.0.176.193:42209/ using document root <none> and password file <none>
I20260812 06:17:20.552007 1270 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:20.552081 1270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:20.552250 1270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:20.553431 1270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/data/instance:
uuid: "14ce902c035a4405a9e17c0aa0eda07f"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "327b137f6b359596fee72937714cfd19"
server_key_iv: "7690829d27f5aeed72473f8756e4dc4e"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.553826 1270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/wal/instance:
uuid: "14ce902c035a4405a9e17c0aa0eda07f"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "327b137f6b359596fee72937714cfd19"
server_key_iv: "7690829d27f5aeed72473f8756e4dc4e"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.555256 1270 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:17:20.556171 1290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:20.556430 1270 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:20.556541 1270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/wal
uuid: "14ce902c035a4405a9e17c0aa0eda07f"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "327b137f6b359596fee72937714cfd19"
server_key_iv: "7690829d27f5aeed72473f8756e4dc4e"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.556622 1270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:20.577885 1270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:20.578181 1270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:20.578289 1270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:20.578563 1270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:20.578928 1270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:20.578979 1270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:20.579042 1270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:20.579068 1270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:20.585191 1270 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.193:37423
I20260812 06:17:20.585299 1458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.193:37423 every 8 connection(s)
I20260812 06:17:20.585644 1270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/data/info.pb
I20260812 06:17:20.587752 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 1270
I20260812 06:17:20.587854 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-0/wal/instance
I20260812 06:17:20.588057 707 external_mini_cluster.cc:1428] Setting key 18513955411fbfbcd4cd031d5b66d733
I20260812 06:17:20.589176 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.194:0
--local_ip_for_outbound_sockets=127.0.176.194
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:33333
--builtin_ntp_servers=127.0.176.212:41171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 06:17:20.592306 1242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.586514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.193:34475 (local address 127.0.176.254:33333)
0812 06:17:20.586582 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.586584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.586856 (+ 272us) server_negotiation.cc:407] Connection header received
0812 06:17:20.587336 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.587337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.587350 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.587448 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:20.588371 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.589108 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.590235 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.590568 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.590655 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.591975 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:20.591976 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:20.591977 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:20.591983 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:20.592002 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:20.592007 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:20.592069 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.592149 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.592183 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:17:20.592496 1465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.586496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:33333 (local address 127.0.176.193:34475)
0812 06:17:20.586717 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.586752 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.587250 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.587520 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.587524 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.587532 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:20.588175 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.588181 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.589209 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.589210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.590109 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.590111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.590779 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.590781 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.591005 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.591802 (+ 797us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:17:20.591803 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:20.591834 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:17:20.591861 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:20.592088 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:20.592094 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:20.592097 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.592148 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.592252 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":116,"threads_started":1}
I20260812 06:17:20.593078 1461 heartbeater.cc:347] Connected to a master server at 127.0.176.254:33333
I20260812 06:17:20.593199 1461 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:20.593425 1461 heartbeater.cc:511] Master 127.0.176.254:33333 requested a full tablet report, sending...
I20260812 06:17:20.593966 1181 ts_manager.cc:194] Registered new tserver with Master: 14ce902c035a4405a9e17c0aa0eda07f (127.0.176.193:37423)
I20260812 06:17:20.594671 1181 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.176.193:34475
W20260812 06:17:20.675225 1466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:20.675547 1466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:20.675601 1466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:20.676849 1466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:20.676898 1466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:20.676925 1466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.194
I20260812 06:17:20.678444 1466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:41171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.176.194
--webserver_port=0
--tserver_master_addrs=127.0.176.254:33333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.194
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:20.678665 1466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:20.678977 1466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:20.684115 1473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:20.684103 1478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:20.684104 1472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:20.684407 1466 server_base.cc:1034] running on GCE node
I20260812 06:17:20.684641 1466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:20.684942 1466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:20.686190 1466 hybrid_clock.cc:648] HybridClock initialized: now 1786515440686165 us; error 41 us; skew 500 ppm
I20260812 06:17:20.687721 1466 webserver.cc:460] Webserver started at http://127.0.176.194:45529/ using document root <none> and password file <none>
I20260812 06:17:20.688014 1466 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:20.688084 1466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:20.688246 1466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:20.689375 1466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/data/instance:
uuid: "b74fdc4bed4c42fdae08a38edfca89b1"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "c3903d0fbdf33e9b7b154f4f53990fa6"
server_key_iv: "c631f18cdabcc07d5bf8734143ae7359"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.689754 1466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/wal/instance:
uuid: "b74fdc4bed4c42fdae08a38edfca89b1"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "c3903d0fbdf33e9b7b154f4f53990fa6"
server_key_iv: "c631f18cdabcc07d5bf8734143ae7359"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.691160 1466 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:17:20.692109 1487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:20.692306 1466 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:20.692411 1466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/wal
uuid: "b74fdc4bed4c42fdae08a38edfca89b1"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "c3903d0fbdf33e9b7b154f4f53990fa6"
server_key_iv: "c631f18cdabcc07d5bf8734143ae7359"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.692502 1466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:20.705248 1466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:20.705608 1466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:20.705768 1466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:20.706034 1466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:20.706425 1466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:20.706480 1466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:20.706523 1466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:20.706553 1466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:20.712591 1466 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.194:40681
I20260812 06:17:20.712638 1673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.194:40681 every 8 connection(s)
I20260812 06:17:20.712991 1466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/data/info.pb
I20260812 06:17:20.716471 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 1466
I20260812 06:17:20.716583 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/wal/instance
I20260812 06:17:20.716801 707 external_mini_cluster.cc:1428] Setting key e9ba172597d914b1513f656579b3258c
I20260812 06:17:20.717840 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.176.195:0
--local_ip_for_outbound_sockets=127.0.176.195
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:33333
--builtin_ntp_servers=127.0.176.212:41171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 06:17:20.718727 1242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.713781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.194:54461 (local address 127.0.176.254:33333)
0812 06:17:20.713890 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.713892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.714071 (+ 179us) server_negotiation.cc:407] Connection header received
0812 06:17:20.714632 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.714633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.714646 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.714684 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:20.715385 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.715931 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.717157 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.717379 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.717472 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.718408 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:20.718410 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:20.718410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:20.718416 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:20.718434 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:20.718439 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:20.718501 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.718576 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.718608 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 06:17:20.718852 1677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.713686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:33333 (local address 127.0.176.194:54461)
0812 06:17:20.713947 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.713983 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.714511 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.714765 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.714768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.714776 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:20.715289 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.715293 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.716040 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.716041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.717067 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.717070 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.717497 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.717498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.717671 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.718261 (+ 590us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:17:20.718261 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:20.718291 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:17:20.718315 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:20.718504 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:20.718507 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:20.718509 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.718559 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.718642 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":110,"threads_started":1}
I20260812 06:17:20.719797 1674 heartbeater.cc:347] Connected to a master server at 127.0.176.254:33333
I20260812 06:17:20.719923 1674 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:20.720120 1674 heartbeater.cc:511] Master 127.0.176.254:33333 requested a full tablet report, sending...
I20260812 06:17:20.720552 1181 ts_manager.cc:194] Registered new tserver with Master: b74fdc4bed4c42fdae08a38edfca89b1 (127.0.176.194:40681)
I20260812 06:17:20.720947 1181 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.176.194:54461
W20260812 06:17:20.804821 1678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:20.805088 1678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:20.805131 1678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:20.806329 1678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:20.806408 1678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:20.806455 1678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.176.195
I20260812 06:17:20.808099 1678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:41171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.176.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.176.195
--webserver_port=0
--tserver_master_addrs=127.0.176.254:33333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.176.195
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:20.808416 1678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:20.808763 1678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:17:20.814103 1678 server_base.cc:1034] running on GCE node
W20260812 06:17:20.814071 1687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:20.814072 1686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:20.814071 1691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:20.814646 1678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:20.814934 1678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:20.816087 1678 hybrid_clock.cc:648] HybridClock initialized: now 1786515440816074 us; error 34 us; skew 500 ppm
I20260812 06:17:20.817492 1678 webserver.cc:460] Webserver started at http://127.0.176.195:42941/ using document root <none> and password file <none>
I20260812 06:17:20.817783 1678 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:20.817860 1678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:20.818028 1678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:20.819186 1678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/data/instance:
uuid: "a9444c255f74436eb55d967e3b742785"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "81ee40c832533385f8afe49a207ac459"
server_key_iv: "e262827d860c369f242a32d9a0bbbc67"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.819607 1678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/wal/instance:
uuid: "a9444c255f74436eb55d967e3b742785"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "81ee40c832533385f8afe49a207ac459"
server_key_iv: "e262827d860c369f242a32d9a0bbbc67"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.821033 1678 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:20.821872 1701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:20.822096 1678 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:20.822196 1678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/wal
uuid: "a9444c255f74436eb55d967e3b742785"
format_stamp: "Formatted at 2026-08-12 06:17:20 on dist-test-slave-gw5c"
server_key: "81ee40c832533385f8afe49a207ac459"
server_key_iv: "e262827d860c369f242a32d9a0bbbc67"
server_key_version: "encryptionkey@0"
I20260812 06:17:20.822284 1678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:20.834338 1678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:20.834712 1678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:20.834872 1678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:20.835124 1678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:17:20.835556 1678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:17:20.835613 1678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:20.835657 1678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:17:20.835685 1678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:20.842272 1678 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.195:34779
I20260812 06:17:20.842329 1886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.195:34779 every 8 connection(s)
I20260812 06:17:20.842747 1678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/data/info.pb
I20260812 06:17:20.844971 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 1678
I20260812 06:17:20.845069 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/wal/instance
I20260812 06:17:20.845268 707 external_mini_cluster.cc:1428] Setting key abc46ae2187919afd285ceb00a50ee73
I20260812 06:17:20.848560 1242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.843642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:37937 (local address 127.0.176.254:33333)
0812 06:17:20.843727 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.843730 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.844001 (+ 271us) server_negotiation.cc:407] Connection header received
0812 06:17:20.844495 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.844496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.844508 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.844565 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:20.845326 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.846087 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.847210 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.847458 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.847539 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.848355 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:20.848356 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:20.848356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:20.848361 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:20.848375 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:20.848379 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:20.848425 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.848476 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.848498 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 06:17:20.848848 1892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.843636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:33333 (local address 127.0.176.195:37937)
0812 06:17:20.843873 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.843910 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.844403 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.844617 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.844619 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.844627 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:20.845226 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.845231 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.846243 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.846245 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.847110 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.847114 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.847553 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.847555 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.847686 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.848214 (+ 528us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:17:20.848214 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:20.848243 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:17:20.848268 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:20.848425 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:20.848428 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:20.848430 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.848478 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.848563 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":119,"threads_started":1}
I20260812 06:17:20.849423 1888 heartbeater.cc:347] Connected to a master server at 127.0.176.254:33333
I20260812 06:17:20.849547 1888 heartbeater.cc:464] Registering TS with master...
I20260812 06:17:20.849792 1888 heartbeater.cc:511] Master 127.0.176.254:33333 requested a full tablet report, sending...
I20260812 06:17:20.850242 1181 ts_manager.cc:194] Registered new tserver with Master: a9444c255f74436eb55d967e3b742785 (127.0.176.195:34779)
I20260812 06:17:20.850690 1181 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.176.195:37937
I20260812 06:17:20.857437 707 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:17:20.862262 1242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.859082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38394 (local address 127.0.176.254:33333)
0812 06:17:20.859152 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.859154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.859185 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:17:20.859241 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.859242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.859251 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.859310 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:20.859610 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.860098 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.860921 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.861110 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.861191 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.861978 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:20.861979 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:20.861979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:20.861986 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:20.862006 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:20.862010 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:20.862071 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.862132 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.862158 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 06:17:20.864566 1181 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38394:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:17:20.866230 1181 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:17:20.873567 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.869521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41948 (local address 127.0.176.194:40681)
0812 06:17:20.869836 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.869841 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.870015 (+ 174us) server_negotiation.cc:407] Connection header received
0812 06:17:20.870063 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.870065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.870080 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.870154 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:20.870306 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.871467 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.872683 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.873198 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.873300 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.873411 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.873439 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.873475 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":117,"threads_started":1}
I20260812 06:17:20.873558 1904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.869086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:40681 (local address 127.0.0.1:41948)
0812 06:17:20.869929 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.869940 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.869999 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.870171 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.870172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.870174 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:20.870214 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.870216 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.871559 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.871560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.872613 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.872615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.873300 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.873301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.873362 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.873367 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.873420 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.873467 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":824,"thread_start_us":78,"threads_started":1}
I20260812 06:17:20.873725 1903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.868807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:37423 (local address 127.0.0.1:52526)
0812 06:17:20.868962 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.869035 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.869137 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.869549 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.869553 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.869556 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:20.869652 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.869655 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.871104 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.871105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.872246 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.872249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.873178 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.873180 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.873272 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.873290 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.873356 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.873426 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":2,"thread_start_us":102,"threads_started":1}
I20260812 06:17:20.874166 1905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.868814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.195:34779 (local address 127.0.0.1:40452)
0812 06:17:20.869869 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.869878 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.869937 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.870246 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.870247 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.870250 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:20.870299 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.870301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.871194 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.871195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.872500 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.872502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.873543 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.873544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.873607 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.873611 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.874032 (+ 421us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.874081 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1038,"mutex_wait_us":22,"thread_start_us":112,"threads_started":1}
I20260812 06:17:20.874220 1908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.869242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40452 (local address 127.0.176.195:34779)
0812 06:17:20.869425 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.869429 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.869934 (+ 505us) server_negotiation.cc:407] Connection header received
0812 06:17:20.870020 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.870023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.870040 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.870114 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:20.870360 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.871095 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.872603 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.873333 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.873412 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.873504 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.874083 (+ 579us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.874137 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":87,"threads_started":1}
I20260812 06:17:20.874552 1566 tablet_service.cc:1467] Processing CreateTablet for tablet 2ca120c852fb4f2d8fcbe8a43b897a6a (DEFAULT_TABLE table=test-table [id=e89d2d13e06946e68c1c69ea6ef55512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:20.874708 1907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.869106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52526 (local address 127.0.176.193:37423)
0812 06:17:20.869319 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.869324 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.869337 (+ 13us) server_negotiation.cc:407] Connection header received
0812 06:17:20.869384 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.869387 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.869405 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.869743 (+ 338us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:20.869801 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.870993 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.872345 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.873064 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.873524 (+ 460us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.873617 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.874581 (+ 964us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.874635 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":94,"threads_started":1}
I20260812 06:17:20.875012 1566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ca120c852fb4f2d8fcbe8a43b897a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:20.874925 1777 tablet_service.cc:1467] Processing CreateTablet for tablet 2ca120c852fb4f2d8fcbe8a43b897a6a (DEFAULT_TABLE table=test-table [id=e89d2d13e06946e68c1c69ea6ef55512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:20.875263 1777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ca120c852fb4f2d8fcbe8a43b897a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:20.875347 1361 tablet_service.cc:1467] Processing CreateTablet for tablet 2ca120c852fb4f2d8fcbe8a43b897a6a (DEFAULT_TABLE table=test-table [id=e89d2d13e06946e68c1c69ea6ef55512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:17:20.875672 1361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ca120c852fb4f2d8fcbe8a43b897a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:20.878793 1910 tablet_bootstrap.cc:492] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f: Bootstrap starting.
I20260812 06:17:20.878875 1913 tablet_bootstrap.cc:492] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1: Bootstrap starting.
I20260812 06:17:20.879536 1910 tablet_bootstrap.cc:654] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:20.879570 1913 tablet_bootstrap.cc:654] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:20.879581 1912 tablet_bootstrap.cc:492] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785: Bootstrap starting.
I20260812 06:17:20.879869 1910 log.cc:824] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:20.879936 1913 log.cc:824] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:20.880263 1912 tablet_bootstrap.cc:654] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:20.880635 1912 log.cc:824] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:20.880844 1913 tablet_bootstrap.cc:492] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1: No bootstrap required, opened a new log
I20260812 06:17:20.880878 1910 tablet_bootstrap.cc:492] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f: No bootstrap required, opened a new log
I20260812 06:17:20.880975 1910 ts_tablet_manager.cc:1397] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:17:20.880982 1913 ts_tablet_manager.cc:1397] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:17:20.881572 1912 tablet_bootstrap.cc:492] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785: No bootstrap required, opened a new log
I20260812 06:17:20.881738 1912 ts_tablet_manager.cc:1397] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:17:20.883159 1910 raft_consensus.cc:348] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9444c255f74436eb55d967e3b742785" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 34779 } } peers { permanent_uuid: "b74fdc4bed4c42fdae08a38edfca89b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 40681 } } peers { permanent_uuid: "14ce902c035a4405a9e17c0aa0eda07f" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37423 } }
I20260812 06:17:20.883319 1910 raft_consensus.cc:374] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:20.883428 1910 raft_consensus.cc:729] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ce902c035a4405a9e17c0aa0eda07f, State: Initialized, Role: FOLLOWER
I20260812 06:17:20.883574 1910 consensus_queue.cc:260] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9444c255f74436eb55d967e3b742785" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 34779 } } peers { permanent_uuid: "b74fdc4bed4c42fdae08a38edfca89b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 40681 } } peers { permanent_uuid: "14ce902c035a4405a9e17c0aa0eda07f" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37423 } }
I20260812 06:17:20.883924 1461 heartbeater.cc:503] Master 127.0.176.254:33333 was elected leader, sending a full tablet report...
I20260812 06:17:20.883904 1913 raft_consensus.cc:348] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9444c255f74436eb55d967e3b742785" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 34779 } } peers { permanent_uuid: "b74fdc4bed4c42fdae08a38edfca89b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 40681 } } peers { permanent_uuid: "14ce902c035a4405a9e17c0aa0eda07f" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37423 } }
I20260812 06:17:20.884080 1913 raft_consensus.cc:374] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:20.884130 1913 raft_consensus.cc:729] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b74fdc4bed4c42fdae08a38edfca89b1, State: Initialized, Role: FOLLOWER
I20260812 06:17:20.884195 1910 ts_tablet_manager.cc:1428] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:17:20.884382 1913 consensus_queue.cc:260] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9444c255f74436eb55d967e3b742785" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 34779 } } peers { permanent_uuid: "b74fdc4bed4c42fdae08a38edfca89b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 40681 } } peers { permanent_uuid: "14ce902c035a4405a9e17c0aa0eda07f" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37423 } }
I20260812 06:17:20.884680 1913 ts_tablet_manager.cc:1428] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260812 06:17:20.884717 1674 heartbeater.cc:503] Master 127.0.176.254:33333 was elected leader, sending a full tablet report...
I20260812 06:17:20.884951 1912 raft_consensus.cc:348] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9444c255f74436eb55d967e3b742785" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 34779 } } peers { permanent_uuid: "b74fdc4bed4c42fdae08a38edfca89b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 40681 } } peers { permanent_uuid: "14ce902c035a4405a9e17c0aa0eda07f" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37423 } }
I20260812 06:17:20.885135 1912 raft_consensus.cc:374] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:20.885174 1912 raft_consensus.cc:729] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9444c255f74436eb55d967e3b742785, State: Initialized, Role: FOLLOWER
I20260812 06:17:20.885291 1912 consensus_queue.cc:260] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9444c255f74436eb55d967e3b742785" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 34779 } } peers { permanent_uuid: "b74fdc4bed4c42fdae08a38edfca89b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 40681 } } peers { permanent_uuid: "14ce902c035a4405a9e17c0aa0eda07f" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37423 } }
I20260812 06:17:20.885576 1912 ts_tablet_manager.cc:1428] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 06:17:20.885699 1888 heartbeater.cc:503] Master 127.0.176.254:33333 was elected leader, sending a full tablet report...
W20260812 06:17:20.963637 1676 tablet.cc:2369] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:17:20.969579 1921 raft_consensus.cc:482] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:17:20.969729 1921 raft_consensus.cc:504] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9444c255f74436eb55d967e3b742785" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 34779 } } peers { permanent_uuid: "b74fdc4bed4c42fdae08a38edfca89b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 40681 } } peers { permanent_uuid: "14ce902c035a4405a9e17c0aa0eda07f" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37423 } }
I20260812 06:17:20.970148 1921 leader_election.cc:288] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b74fdc4bed4c42fdae08a38edfca89b1 (127.0.176.194:40681), 14ce902c035a4405a9e17c0aa0eda07f (127.0.176.193:37423)
I20260812 06:17:20.973644 1907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.970522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:37479 (local address 127.0.176.193:37423)
0812 06:17:20.970614 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.970617 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.970735 (+ 118us) server_negotiation.cc:407] Connection header received
0812 06:17:20.970785 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.970786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.970797 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.970863 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:20.971057 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.971695 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.972668 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.973213 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.973289 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.973297 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.973508 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.973561 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 06:17:20.973672 1892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.970406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.194:40681 (local address 127.0.176.195:47239)
0812 06:17:20.970459 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.970473 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.970518 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.970946 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.970947 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.970949 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:20.971037 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.971039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.971700 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.971702 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.972521 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.972524 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.973378 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.973379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.973443 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.973453 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.973528 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.973581 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":4}
I20260812 06:17:20.973672 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.970660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.176.195:47239 (local address 127.0.176.194:40681)
0812 06:17:20.970753 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.970755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.970765 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:17:20.970800 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.970801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.970810 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.970894 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:17:20.971126 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.971610 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.972634 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.973227 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.973354 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.973363 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.973555 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.973604 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 06:17:20.973680 1923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.970408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:37423 (local address 127.0.176.195:37479)
0812 06:17:20.970635 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:20.970644 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:20.970727 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:20.970892 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:20.970893 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:20.970894 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:17:20.970983 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.970985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.971788 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.971789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.972543 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:20.972545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.973337 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.973338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:20.973433 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.973437 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:17:20.973484 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 06:17:20.973552 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":61,"thread_start_us":126,"threads_started":1}
I20260812 06:17:20.974109 1601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca120c852fb4f2d8fcbe8a43b897a6a" candidate_uuid: "a9444c255f74436eb55d967e3b742785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74fdc4bed4c42fdae08a38edfca89b1" is_pre_election: true
I20260812 06:17:20.974110 1393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca120c852fb4f2d8fcbe8a43b897a6a" candidate_uuid: "a9444c255f74436eb55d967e3b742785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14ce902c035a4405a9e17c0aa0eda07f" is_pre_election: true
I20260812 06:17:20.974293 1393 raft_consensus.cc:2454] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9444c255f74436eb55d967e3b742785 in term 0.
I20260812 06:17:20.974293 1601 raft_consensus.cc:2454] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9444c255f74436eb55d967e3b742785 in term 0.
I20260812 06:17:20.974565 1704 leader_election.cc:302] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 14ce902c035a4405a9e17c0aa0eda07f, a9444c255f74436eb55d967e3b742785, b74fdc4bed4c42fdae08a38edfca89b1; no voters:
I20260812 06:17:20.974715 1921 raft_consensus.cc:2781] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:17:20.974776 1921 raft_consensus.cc:482] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:17:20.974805 1921 raft_consensus.cc:3037] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:20.975567 1921 raft_consensus.cc:504] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9444c255f74436eb55d967e3b742785" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 34779 } } peers { permanent_uuid: "b74fdc4bed4c42fdae08a38edfca89b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 40681 } } peers { permanent_uuid: "14ce902c035a4405a9e17c0aa0eda07f" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37423 } }
I20260812 06:17:20.975732 1921 leader_election.cc:288] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [CANDIDATE]: Term 1 election: Requested vote from peers b74fdc4bed4c42fdae08a38edfca89b1 (127.0.176.194:40681), 14ce902c035a4405a9e17c0aa0eda07f (127.0.176.193:37423)
I20260812 06:17:20.975962 1601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca120c852fb4f2d8fcbe8a43b897a6a" candidate_uuid: "a9444c255f74436eb55d967e3b742785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74fdc4bed4c42fdae08a38edfca89b1"
I20260812 06:17:20.975963 1393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca120c852fb4f2d8fcbe8a43b897a6a" candidate_uuid: "a9444c255f74436eb55d967e3b742785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14ce902c035a4405a9e17c0aa0eda07f"
I20260812 06:17:20.976053 1393 raft_consensus.cc:3037] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:20.976054 1601 raft_consensus.cc:3037] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:20.977025 1393 raft_consensus.cc:2454] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9444c255f74436eb55d967e3b742785 in term 1.
I20260812 06:17:20.977025 1601 raft_consensus.cc:2454] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9444c255f74436eb55d967e3b742785 in term 1.
I20260812 06:17:20.977241 1704 leader_election.cc:302] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14ce902c035a4405a9e17c0aa0eda07f, a9444c255f74436eb55d967e3b742785; no voters:
I20260812 06:17:20.977463 1921 raft_consensus.cc:2781] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:20.977697 1921 raft_consensus.cc:686] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [term 1 LEADER]: Becoming Leader. State: Replica: a9444c255f74436eb55d967e3b742785, State: Running, Role: LEADER
I20260812 06:17:20.977828 1921 consensus_queue.cc:237] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9444c255f74436eb55d967e3b742785" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 34779 } } peers { permanent_uuid: "b74fdc4bed4c42fdae08a38edfca89b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 40681 } } peers { permanent_uuid: "14ce902c035a4405a9e17c0aa0eda07f" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37423 } }
I20260812 06:17:20.978797 1179 catalog_manager.cc:5495] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9444c255f74436eb55d967e3b742785 (127.0.176.195). New cstate: current_term: 1 leader_uuid: "a9444c255f74436eb55d967e3b742785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9444c255f74436eb55d967e3b742785" member_type: VOTER last_known_addr { host: "127.0.176.195" port: 34779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b74fdc4bed4c42fdae08a38edfca89b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 40681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14ce902c035a4405a9e17c0aa0eda07f" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37423 } health_report { overall_health: UNKNOWN } } }
I20260812 06:17:20.991549 1908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:20.989024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40460 (local address 127.0.176.195:34779)
0812 06:17:20.989074 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:20.989075 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:20.989089 (+ 14us) server_negotiation.cc:407] Connection header received
0812 06:17:20.989187 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:20.989187 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:20.989207 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:20.989271 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:20.989373 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.989856 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.990692 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:20.990889 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:20.990953 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:20.991073 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:20.991179 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:20.991240 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:20.991349 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 06:17:20.991378 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:17:20.993620 1601 raft_consensus.cc:1261] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1 [term 1 FOLLOWER]: Refusing update from remote peer a9444c255f74436eb55d967e3b742785: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:20.993620 1393 raft_consensus.cc:1261] T 2ca120c852fb4f2d8fcbe8a43b897a6a P 14ce902c035a4405a9e17c0aa0eda07f [term 1 FOLLOWER]: Refusing update from remote peer a9444c255f74436eb55d967e3b742785: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:20.994048 1924 consensus_queue.cc:1035] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b74fdc4bed4c42fdae08a38edfca89b1" member_type: VOTER last_known_addr { host: "127.0.176.194" port: 40681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:20.994210 1921 consensus_queue.cc:1035] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14ce902c035a4405a9e17c0aa0eda07f" member_type: VOTER last_known_addr { host: "127.0.176.193" port: 37423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:20.997534 1932 mvcc.cc:205] Tried to move back new op lower bound from 7317567246306963456 to 7317567246245933056. Current Snapshot: MvccSnapshot[applied={T|T < 7317567246306963456}]
I20260812 06:17:20.997686 1930 mvcc.cc:205] Tried to move back new op lower bound from 7317567246306963456 to 7317567246245933056. Current Snapshot: MvccSnapshot[applied={T|T < 7317567246306963456 or (T in {7317567246306963456})}]
I20260812 06:17:20.998193 1931 mvcc.cc:205] Tried to move back new op lower bound from 7317567246306963456 to 7317567246245933056. Current Snapshot: MvccSnapshot[applied={T|T < 7317567246306963456}]
I20260812 06:17:20.999740 1179 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38394:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:17:20.999837 1179 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38394:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:17:21.000629 1179 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 94e206d757444743bb3625b144e8a100: Sending DeleteTablet for 3 replicas of tablet 2ca120c852fb4f2d8fcbe8a43b897a6a
I20260812 06:17:21.000941 1777 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ca120c852fb4f2d8fcbe8a43b897a6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:20 UTC) from {username='slave'} at 127.0.0.1:40452
I20260812 06:17:21.000999 1566 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ca120c852fb4f2d8fcbe8a43b897a6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:20 UTC) from {username='slave'} at 127.0.0.1:41948
I20260812 06:17:21.001209 1361 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ca120c852fb4f2d8fcbe8a43b897a6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:17:20 UTC) from {username='slave'} at 127.0.0.1:52526
I20260812 06:17:21.001417 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 1270
I20260812 06:17:21.010903 1942 tablet_replica.cc:330] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785: stopping tablet replica
I20260812 06:17:21.011106 1942 raft_consensus.cc:2229] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:17:21.011247 1942 raft_consensus.cc:2258] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:21.001340 1944 tablet_replica.cc:330] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1: stopping tablet replica
I20260812 06:17:21.011498 1944 raft_consensus.cc:2229] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:17:21.011636 1944 raft_consensus.cc:2258] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:17:21.013832 1944 ts_tablet_manager.cc:1905] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:17:21.013896 1942 ts_tablet_manager.cc:1905] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:17:21.015784 1944 ts_tablet_manager.cc:1918] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:17:21.015892 1944 log.cc:1196] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-1/wal/wals/2ca120c852fb4f2d8fcbe8a43b897a6a
I20260812 06:17:21.016188 1944 ts_tablet_manager.cc:1939] T 2ca120c852fb4f2d8fcbe8a43b897a6a P b74fdc4bed4c42fdae08a38edfca89b1: Deleting consensus metadata
I20260812 06:17:21.016239 1942 ts_tablet_manager.cc:1918] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:17:21.016319 1942 log.cc:1196] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785: Deleting WAL directory at /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515178947866-707-0/minicluster-data/ts-2/wal/wals/2ca120c852fb4f2d8fcbe8a43b897a6a
I20260812 06:17:21.016598 1942 ts_tablet_manager.cc:1939] T 2ca120c852fb4f2d8fcbe8a43b897a6a P a9444c255f74436eb55d967e3b742785: Deleting consensus metadata
I20260812 06:17:21.016744 1159 catalog_manager.cc:4841] TS b74fdc4bed4c42fdae08a38edfca89b1 (127.0.176.194:40681): tablet 2ca120c852fb4f2d8fcbe8a43b897a6a (table test-table [id=e89d2d13e06946e68c1c69ea6ef55512]) successfully deleted
I20260812 06:17:21.016975 1159 catalog_manager.cc:4841] TS a9444c255f74436eb55d967e3b742785 (127.0.176.195:34779): tablet 2ca120c852fb4f2d8fcbe8a43b897a6a (table test-table [id=e89d2d13e06946e68c1c69ea6ef55512]) successfully deleted
W20260812 06:17:21.023501 1157 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.176.193:37423 (error 108)
I20260812 06:17:21.024132 1905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:21.023964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.193:37423 (local address 127.0.0.1:52536)
0812 06:17:21.024038 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:21.024089 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.193:37423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 06:17:21.024223 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 1466
W20260812 06:17:21.054754 1157 catalog_manager.cc:4584] TS 14ce902c035a4405a9e17c0aa0eda07f (127.0.176.193:37423): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2ca120c852fb4f2d8fcbe8a43b897a6a: Network error: Client connection negotiation failed: client connection to 127.0.176.193:37423: connect: Connection refused (error 111)
I20260812 06:17:21.073889 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 1678
I20260812 06:17:21.090744 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 1135
2026-08-12T06:17:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (839 ms)
[----------] 6 tests from EncryptionPolicyTest (9675 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:21 dist-test-slave-gw5c krb5kdc[1953](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:21 dist-test-slave-gw5c krb5kdc[1953](info): set up 2 sockets
Aug 12 06:17:21 dist-test-slave-gw5c krb5kdc[1953](info): commencing operation
krb5kdc: starting...
W20260812 06:17:22.395740 707 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:22 dist-test-slave-gw5c krb5kdc[1953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:17:22.530040 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46649
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:22.624754 1970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:22.625034 1970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:22.625078 1970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:22.626338 1970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:22.626411 1970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:22.626437 1970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:22.626466 1970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:22.626497 1970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:22.628178 1970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46649
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:22.628501 1970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:22.628893 1970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:22.634320 1979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:22.634276 1982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:22.634272 1978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:22.634614 1970 server_base.cc:1034] running on GCE node
I20260812 06:17:22.634884 1970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:22.635202 1970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:22.636379 1970 hybrid_clock.cc:648] HybridClock initialized: now 1786515442636368 us; error 39 us; skew 500 ppm
Aug 12 06:17:22 dist-test-slave-gw5c krb5kdc[1953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515442, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:22.639187 1970 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:17:22.639744 1970 webserver.cc:460] Webserver started at http://127.0.0.1:40977/ using document root <none> and password file <none>
I20260812 06:17:22.640025 1970 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:22.640100 1970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:22.640257 1970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:22.641383 1970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "c47a98bbaf1941d0a63933d9048bf0b4"
format_stamp: "Formatted at 2026-08-12 06:17:22 on dist-test-slave-gw5c"
server_key: "9dbb076fc402589f38cfbe132af4a6d1"
server_key_iv: "5df9311371d651247021c164bc83e751"
server_key_version: "encryptionkey@0"
I20260812 06:17:22.641780 1970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "c47a98bbaf1941d0a63933d9048bf0b4"
format_stamp: "Formatted at 2026-08-12 06:17:22 on dist-test-slave-gw5c"
server_key: "9dbb076fc402589f38cfbe132af4a6d1"
server_key_iv: "5df9311371d651247021c164bc83e751"
server_key_version: "encryptionkey@0"
I20260812 06:17:22.643266 1970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:17:22.644191 1995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:22.644377 1970 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:22.644476 1970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "c47a98bbaf1941d0a63933d9048bf0b4"
format_stamp: "Formatted at 2026-08-12 06:17:22 on dist-test-slave-gw5c"
server_key: "9dbb076fc402589f38cfbe132af4a6d1"
server_key_iv: "5df9311371d651247021c164bc83e751"
server_key_version: "encryptionkey@0"
I20260812 06:17:22.644563 1970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:22.661566 1970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:22.664539 1970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:22.664723 1970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:22.671032 1970 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46649
I20260812 06:17:22.671129 2068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46649 every 8 connection(s)
I20260812 06:17:22.671795 1970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:22.672891 2070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:22.675856 2070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4: Bootstrap starting.
I20260812 06:17:22.676538 2070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:22.676891 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 1970
I20260812 06:17:22.677048 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:22.677102 2070 log.cc:824] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:22.677291 707 external_mini_cluster.cc:1428] Setting key b7912d45ee2872b512e5943900de8cfb
I20260812 06:17:22.678154 2070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4: No bootstrap required, opened a new log
I20260812 06:17:22.680855 2070 raft_consensus.cc:348] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47a98bbaf1941d0a63933d9048bf0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46649 } }
I20260812 06:17:22.681054 2070 raft_consensus.cc:374] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:22.681108 2070 raft_consensus.cc:729] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47a98bbaf1941d0a63933d9048bf0b4, State: Initialized, Role: FOLLOWER
I20260812 06:17:22.681265 2070 consensus_queue.cc:260] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47a98bbaf1941d0a63933d9048bf0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46649 } }
I20260812 06:17:22.681370 2070 raft_consensus.cc:388] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:22.681417 2070 raft_consensus.cc:482] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:22.681469 2070 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:22.682168 2070 raft_consensus.cc:504] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47a98bbaf1941d0a63933d9048bf0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46649 } }
I20260812 06:17:22.682304 2070 leader_election.cc:302] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c47a98bbaf1941d0a63933d9048bf0b4; no voters:
I20260812 06:17:22.682499 2070 leader_election.cc:288] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:22.682565 2077 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:22.682735 2077 raft_consensus.cc:686] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [term 1 LEADER]: Becoming Leader. State: Replica: c47a98bbaf1941d0a63933d9048bf0b4, State: Running, Role: LEADER
I20260812 06:17:22.682825 2077 consensus_queue.cc:237] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47a98bbaf1941d0a63933d9048bf0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46649 } }
I20260812 06:17:22.683012 2070 sys_catalog.cc:564] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:22.684725 2078 sys_catalog.cc:455] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c47a98bbaf1941d0a63933d9048bf0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47a98bbaf1941d0a63933d9048bf0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46649 } } }
I20260812 06:17:22.684832 2078 sys_catalog.cc:458] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [sys.catalog]: This master's current role is: LEADER
Aug 12 06:17:22 dist-test-slave-gw5c krb5kdc[1953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 06:17:22.685098 2079 sys_catalog.cc:455] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c47a98bbaf1941d0a63933d9048bf0b4. Latest consensus state: current_term: 1 leader_uuid: "c47a98bbaf1941d0a63933d9048bf0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47a98bbaf1941d0a63933d9048bf0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46649 } } }
I20260812 06:17:22.685251 2107 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:22.685281 2079 sys_catalog.cc:458] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:22.685789 2107 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:22.687954 2107 catalog_manager.cc:1347] Generated new cluster ID: 8ae3d30ac6884d86a1f07c3a05ae06ed
I20260812 06:17:22.688010 2107 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:22.689711 2076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:22.677951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39539 (local address 127.0.0.1:46649)
0812 06:17:22.678171 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:22.678179 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:22.678229 (+ 50us) server_negotiation.cc:407] Connection header received
0812 06:17:22.678743 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:22.678751 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:22.678802 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:22.678986 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:22.679775 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:22.680712 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:22.681700 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:22.682151 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:22.682280 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:22.685822 (+ 3542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:22.685827 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:22.685827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:22.685843 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:22.687922 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:22.688444 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:22.688447 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:22.688448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:22.688548 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:22.688790 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:22.688792 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:22.688792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:22.689055 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:22.689255 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:22.689368 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 06:17:22.689479 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":105,"threads_started":1}
I20260812 06:17:22.690801 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:22.696180 2107 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:22.696949 2107 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:22.705265 2076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:22.696283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57461 (local address 127.0.0.1:46649)
0812 06:17:22.696328 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:22.696330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:22.696697 (+ 367us) server_negotiation.cc:407] Connection header received
0812 06:17:22.696743 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:22.696744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:22.696946 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:22.697029 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:22.697763 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:22.698586 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:22.699726 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:22.700078 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:22.700146 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:22.701750 (+ 1604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:22.701751 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:22.701752 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:22.701761 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:22.703788 (+ 2027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:22.704297 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:22.704298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:22.704299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:22.704366 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:22.704606 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:22.704607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:22.704607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:22.704737 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:22.704819 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:22.705094 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 06:17:22.705167 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:17:22.708604 2107 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c47a98bbaf1941d0a63933d9048bf0b4: Generated new TSK 0
I20260812 06:17:22.708823 2107 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:22.711090 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 1970
W20260812 06:17:22.729763 1949 connection.cc:535] client connection to 127.0.0.1:46649 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46649): Connection reset by peer (error 104)
2026-08-12T06:17:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1625 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:22 dist-test-slave-gw5c krb5kdc[2119](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:22 dist-test-slave-gw5c krb5kdc[2119](info): set up 2 sockets
Aug 12 06:17:22 dist-test-slave-gw5c krb5kdc[2119](info): commencing operation
krb5kdc: starting...
W20260812 06:17:24.064713 707 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:24 dist-test-slave-gw5c krb5kdc[2119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:17:24.210686 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35145
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:24.306107 2139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:24.306456 2139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:24.306512 2139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:24.307902 2139 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:24.307973 2139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:24.307998 2139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:24.308027 2139 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:24.308060 2139 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:24.310161 2139 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35145
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2139
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:24.310557 2139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:24.310851 2139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:24.316771 2146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:24.316864 2145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:24.316781 2148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:24.317273 2139 server_base.cc:1034] running on GCE node
I20260812 06:17:24.317585 2139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:24.317998 2139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:24.319214 2139 hybrid_clock.cc:648] HybridClock initialized: now 1786515444319191 us; error 42 us; skew 500 ppm
Aug 12 06:17:24 dist-test-slave-gw5c krb5kdc[2119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515444, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:24.322307 2139 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:17:24.322866 2139 webserver.cc:460] Webserver started at http://127.0.0.1:37087/ using document root <none> and password file <none>
I20260812 06:17:24.323125 2139 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:24.323199 2139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:24.323357 2139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:24.324548 2139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "af1d9cc5ecff4c7886c59b7546b5c881"
format_stamp: "Formatted at 2026-08-12 06:17:24 on dist-test-slave-gw5c"
server_key: "73802aa01df2b3ff039fb3403f586370"
server_key_iv: "e7474669cf71e21373976f711098d562"
server_key_version: "encryptionkey@0"
I20260812 06:17:24.324959 2139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "af1d9cc5ecff4c7886c59b7546b5c881"
format_stamp: "Formatted at 2026-08-12 06:17:24 on dist-test-slave-gw5c"
server_key: "73802aa01df2b3ff039fb3403f586370"
server_key_iv: "e7474669cf71e21373976f711098d562"
server_key_version: "encryptionkey@0"
I20260812 06:17:24.326536 2139 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:17:24.327497 2159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:24.327862 2139 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:24.327994 2139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "af1d9cc5ecff4c7886c59b7546b5c881"
format_stamp: "Formatted at 2026-08-12 06:17:24 on dist-test-slave-gw5c"
server_key: "73802aa01df2b3ff039fb3403f586370"
server_key_iv: "e7474669cf71e21373976f711098d562"
server_key_version: "encryptionkey@0"
I20260812 06:17:24.328090 2139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:24.345038 2139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:24.347667 2139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:24.347870 2139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:24.353008 2139 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35145
I20260812 06:17:24.353106 2237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35145 every 8 connection(s)
I20260812 06:17:24.353540 2139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:24.354630 2238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:24.357442 2238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881: Bootstrap starting.
I20260812 06:17:24.357939 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 2139
I20260812 06:17:24.358116 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:24.358275 2238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:24.358362 707 external_mini_cluster.cc:1428] Setting key 59aa008a37d899d529b5996a1572495a
I20260812 06:17:24.358659 2238 log.cc:824] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:24.359649 2238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881: No bootstrap required, opened a new log
I20260812 06:17:24.362757 2238 raft_consensus.cc:348] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1d9cc5ecff4c7886c59b7546b5c881" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35145 } }
I20260812 06:17:24.362957 2238 raft_consensus.cc:374] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:24.363008 2238 raft_consensus.cc:729] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1d9cc5ecff4c7886c59b7546b5c881, State: Initialized, Role: FOLLOWER
I20260812 06:17:24.363200 2238 consensus_queue.cc:260] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1d9cc5ecff4c7886c59b7546b5c881" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35145 } }
I20260812 06:17:24.363305 2238 raft_consensus.cc:388] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:24.363489 2238 raft_consensus.cc:482] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:24.363564 2238 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:24.364472 2238 raft_consensus.cc:504] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1d9cc5ecff4c7886c59b7546b5c881" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35145 } }
I20260812 06:17:24.364620 2238 leader_election.cc:302] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af1d9cc5ecff4c7886c59b7546b5c881; no voters:
I20260812 06:17:24.364888 2238 leader_election.cc:288] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:24.364918 2247 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:24.365120 2247 raft_consensus.cc:686] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [term 1 LEADER]: Becoming Leader. State: Replica: af1d9cc5ecff4c7886c59b7546b5c881, State: Running, Role: LEADER
I20260812 06:17:24.365208 2246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:24.359034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40159 (local address 127.0.0.1:35145)
0812 06:17:24.359269 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:24.359279 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:24.359317 (+ 38us) server_negotiation.cc:407] Connection header received
0812 06:17:24.359919 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:24.359928 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:24.359983 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:24.360109 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:24.360452 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:24.361405 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:24.362708 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:24.363270 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:24.363426 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:24.364369 (+ 943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:24.364379 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:24.364380 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:24.364564 (+ 184us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:24.364629 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:24.364646 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:24.364760 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:24.364855 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 06:17:24.364889 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":103,"threads_started":1}
I20260812 06:17:24.365207 2247 consensus_queue.cc:237] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1d9cc5ecff4c7886c59b7546b5c881" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35145 } }
I20260812 06:17:24.365626 2248 sys_catalog.cc:455] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af1d9cc5ecff4c7886c59b7546b5c881. Latest consensus state: current_term: 1 leader_uuid: "af1d9cc5ecff4c7886c59b7546b5c881" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1d9cc5ecff4c7886c59b7546b5c881" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35145 } } }
I20260812 06:17:24.365626 2251 sys_catalog.cc:455] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af1d9cc5ecff4c7886c59b7546b5c881" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1d9cc5ecff4c7886c59b7546b5c881" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35145 } } }
I20260812 06:17:24.365758 2251 sys_catalog.cc:458] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:24.365222 2238 sys_catalog.cc:564] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:24.365914 2248 sys_catalog.cc:458] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:24.366016 2254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:24.366351 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:24.366677 2254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:24.368992 2254 catalog_manager.cc:1347] Generated new cluster ID: 4bde06bbadfa4a3b98a2fa3ca0405c09
I20260812 06:17:24.369061 2254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:24.372750 2246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:24.368121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51273 (local address 127.0.0.1:35145)
0812 06:17:24.368163 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:24.368165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:24.368856 (+ 691us) server_negotiation.cc:407] Connection header received
0812 06:17:24.368922 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:24.368923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:24.368935 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:24.369000 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:24.369224 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:24.369980 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:24.371213 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:24.371567 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:24.371662 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:24.372462 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:24.372463 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:24.372463 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:24.372469 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:24.372486 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:24.372491 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:24.372550 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:24.372653 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 06:17:24.372667 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:17:24.400357 2254 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:24.400991 2254 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:24.408950 2254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af1d9cc5ecff4c7886c59b7546b5c881: Generated new TSK 0
I20260812 06:17:24.409181 2254 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:24.420964 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 2139
W20260812 06:17:24.441758 2117 connection.cc:535] client connection to 127.0.0.1:35145 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35145): Connection reset by peer (error 104)
2026-08-12T06:17:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1712 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:24 dist-test-slave-gw5c krb5kdc[2292](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:24 dist-test-slave-gw5c krb5kdc[2292](info): set up 2 sockets
Aug 12 06:17:24 dist-test-slave-gw5c krb5kdc[2292](info): commencing operation
krb5kdc: starting...
W20260812 06:17:25.742691 707 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:25 dist-test-slave-gw5c krb5kdc[2292](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:17:25.876573 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42265
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:25.964262 2309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:25.964548 2309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:25.964591 2309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:25.965764 2309 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:25.965819 2309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:25.965888 2309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:25.965909 2309 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:25.965929 2309 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:25.967610 2309 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42265
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:25.967919 2309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:25.968171 2309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:25.973807 2317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:25.973798 2315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:25.973806 2321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:25.974226 2309 server_base.cc:1034] running on GCE node
I20260812 06:17:25.974556 2309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:25.975073 2309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:25.976290 2309 hybrid_clock.cc:648] HybridClock initialized: now 1786515445976252 us; error 76 us; skew 500 ppm
Aug 12 06:17:25 dist-test-slave-gw5c krb5kdc[2292](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515445, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:25.979297 2309 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:17:25.979864 2309 webserver.cc:460] Webserver started at http://127.0.0.1:34219/ using document root <none> and password file <none>
I20260812 06:17:25.980134 2309 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:25.980211 2309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:25.980367 2309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:25.981515 2309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "05e5b1772ba742bebf03760f7b8671c5"
format_stamp: "Formatted at 2026-08-12 06:17:25 on dist-test-slave-gw5c"
server_key: "a7065d463a17b322852c31e98d255cdd"
server_key_iv: "18c38ddcd87f3c463e08e5969af94ad0"
server_key_version: "encryptionkey@0"
I20260812 06:17:25.981914 2309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "05e5b1772ba742bebf03760f7b8671c5"
format_stamp: "Formatted at 2026-08-12 06:17:25 on dist-test-slave-gw5c"
server_key: "a7065d463a17b322852c31e98d255cdd"
server_key_iv: "18c38ddcd87f3c463e08e5969af94ad0"
server_key_version: "encryptionkey@0"
I20260812 06:17:25.983559 2309 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:17:25.984462 2330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:25.984843 2309 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:25.984934 2309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "05e5b1772ba742bebf03760f7b8671c5"
format_stamp: "Formatted at 2026-08-12 06:17:25 on dist-test-slave-gw5c"
server_key: "a7065d463a17b322852c31e98d255cdd"
server_key_iv: "18c38ddcd87f3c463e08e5969af94ad0"
server_key_version: "encryptionkey@0"
I20260812 06:17:25.985047 2309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:25.989246 2309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:25.991636 2309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:25.991822 2309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:25.996735 2309 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42265
I20260812 06:17:25.996778 2406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42265 every 8 connection(s)
I20260812 06:17:25.997144 2309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:25.998111 2407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:26.000665 2407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5: Bootstrap starting.
I20260812 06:17:26.001266 2407 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:26.001538 2407 log.cc:824] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:26.002279 2407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5: No bootstrap required, opened a new log
I20260812 06:17:26.002919 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 2309
I20260812 06:17:26.003075 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:26.003276 707 external_mini_cluster.cc:1428] Setting key 8d2c776c103d9908af061bc3a70f76f7
I20260812 06:17:26.004613 2407 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e5b1772ba742bebf03760f7b8671c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } }
I20260812 06:17:26.004873 2407 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:26.004966 2407 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e5b1772ba742bebf03760f7b8671c5, State: Initialized, Role: FOLLOWER
I20260812 06:17:26.005160 2407 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e5b1772ba742bebf03760f7b8671c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } }
I20260812 06:17:26.005277 2407 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:26.005317 2407 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:26.005370 2407 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:26.006454 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:26.003932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56087 (local address 127.0.0.1:42265)
0812 06:17:26.004135 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:26.004143 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:26.004201 (+ 58us) server_negotiation.cc:407] Connection header received
0812 06:17:26.004560 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:26.004568 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:26.004605 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:26.004776 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:26.005890 (+ 1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:26.005894 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:26.005894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:26.005900 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:26.005976 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:26.005993 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:26.006080 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:26.006145 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 06:17:26.006200 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":112,"threads_started":1}
I20260812 06:17:26.006827 2407 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e5b1772ba742bebf03760f7b8671c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } }
I20260812 06:17:26.006963 2407 leader_election.cc:302] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05e5b1772ba742bebf03760f7b8671c5; no voters:
I20260812 06:17:26.007175 2407 leader_election.cc:288] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:26.007205 2413 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:26.007324 2413 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [term 1 LEADER]: Becoming Leader. State: Replica: 05e5b1772ba742bebf03760f7b8671c5, State: Running, Role: LEADER
I20260812 06:17:26.007437 2413 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e5b1772ba742bebf03760f7b8671c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } }
I20260812 06:17:26.007488 2407 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:26.007483 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:26.007764 2414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05e5b1772ba742bebf03760f7b8671c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e5b1772ba742bebf03760f7b8671c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } } }
I20260812 06:17:26.007795 2415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05e5b1772ba742bebf03760f7b8671c5. Latest consensus state: current_term: 1 leader_uuid: "05e5b1772ba742bebf03760f7b8671c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e5b1772ba742bebf03760f7b8671c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } } }
I20260812 06:17:26.007853 2414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:26.007866 2415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5 [sys.catalog]: This master's current role is: LEADER
W20260812 06:17:26.009472 2456 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:17:26.009537 2456 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:17:26.009586 2429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:26.009761 2429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:26.011149 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:26.009149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38339 (local address 127.0.0.1:42265)
0812 06:17:26.009189 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:26.009192 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:26.009511 (+ 319us) server_negotiation.cc:407] Connection header received
0812 06:17:26.009979 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:26.009981 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:26.009993 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:26.010224 (+ 231us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:26.010895 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:26.010897 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:26.010897 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:26.010901 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:26.010916 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:26.010921 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:26.010980 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:26.011052 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 06:17:26.011070 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:17:26.011564 2429 catalog_manager.cc:1347] Generated new cluster ID: 2cfb9cf95e904ae39b82803ff435878c
I20260812 06:17:26.011619 2429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:26.026913 2429 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:26.027173 2429 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:26.035094 2429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05e5b1772ba742bebf03760f7b8671c5: Generated new TSK 0
I20260812 06:17:26.035341 2429 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:26.038991 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 2309
2026-08-12T06:17:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1617 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:26 dist-test-slave-gw5c krb5kdc[2465](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:26 dist-test-slave-gw5c krb5kdc[2465](info): set up 2 sockets
Aug 12 06:17:26 dist-test-slave-gw5c krb5kdc[2465](info): commencing operation
krb5kdc: starting...
W20260812 06:17:27.355209 707 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:27 dist-test-slave-gw5c krb5kdc[2465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:17:27.486783 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43949
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:27.574312 2488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:27.574584 2488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:27.574630 2488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:27.575860 2488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:27.575937 2488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:27.575964 2488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:27.575999 2488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:27.576023 2488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:27.577584 2488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:27.577893 2488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:27.578138 2488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:27.583051 2505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:27.583060 2502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:27.583112 2503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:27.583302 2488 server_base.cc:1034] running on GCE node
I20260812 06:17:27.583647 2488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:27.583977 2488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:27.585161 2488 hybrid_clock.cc:648] HybridClock initialized: now 1786515447585176 us; error 66 us; skew 500 ppm
Aug 12 06:17:27 dist-test-slave-gw5c krb5kdc[2465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515447, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:27.592940 2488 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:17:27.593497 2488 webserver.cc:460] Webserver started at http://127.0.0.1:42941/ using document root <none> and password file <none>
I20260812 06:17:27.593747 2488 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:27.593820 2488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:27.593979 2488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:27.595110 2488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "8454ff868eb3482789a5b8c737182fca"
format_stamp: "Formatted at 2026-08-12 06:17:27 on dist-test-slave-gw5c"
server_key: "4d6615e9e396df53e39ca42675497645"
server_key_iv: "5fb3301b7faeddf36dd04b434ca182c2"
server_key_version: "encryptionkey@0"
I20260812 06:17:27.595561 2488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "8454ff868eb3482789a5b8c737182fca"
format_stamp: "Formatted at 2026-08-12 06:17:27 on dist-test-slave-gw5c"
server_key: "4d6615e9e396df53e39ca42675497645"
server_key_iv: "5fb3301b7faeddf36dd04b434ca182c2"
server_key_version: "encryptionkey@0"
I20260812 06:17:27.597020 2488 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:27.597892 2514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:27.598120 2488 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:27.598232 2488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "8454ff868eb3482789a5b8c737182fca"
format_stamp: "Formatted at 2026-08-12 06:17:27 on dist-test-slave-gw5c"
server_key: "4d6615e9e396df53e39ca42675497645"
server_key_iv: "5fb3301b7faeddf36dd04b434ca182c2"
server_key_version: "encryptionkey@0"
I20260812 06:17:27.598320 2488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:27.607730 2488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:27.610165 2488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:27.610364 2488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:27.615212 2488 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43949
I20260812 06:17:27.615260 2598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43949 every 8 connection(s)
I20260812 06:17:27.615687 2488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:27.616670 2600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:27.619031 2600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca: Bootstrap starting.
I20260812 06:17:27.619716 2600 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:27.619971 2600 log.cc:824] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:27.620699 2600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca: No bootstrap required, opened a new log
I20260812 06:17:27.622335 2600 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8454ff868eb3482789a5b8c737182fca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43949 } }
I20260812 06:17:27.622483 2600 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:27.622505 2600 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8454ff868eb3482789a5b8c737182fca, State: Initialized, Role: FOLLOWER
I20260812 06:17:27.622612 2600 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8454ff868eb3482789a5b8c737182fca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43949 } }
I20260812 06:17:27.622666 2600 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:27.622687 2600 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:27.622771 2600 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:27.623332 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 2488
I20260812 06:17:27.623478 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:27.623540 2600 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8454ff868eb3482789a5b8c737182fca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43949 } }
I20260812 06:17:27.623663 2600 leader_election.cc:302] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8454ff868eb3482789a5b8c737182fca; no voters:
I20260812 06:17:27.623687 707 external_mini_cluster.cc:1428] Setting key 674c3fc3c9bcf579c9b68e0c5f635c6f
I20260812 06:17:27.623855 2600 leader_election.cc:288] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:27.623926 2603 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:27.624090 2603 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [term 1 LEADER]: Becoming Leader. State: Replica: 8454ff868eb3482789a5b8c737182fca, State: Running, Role: LEADER
I20260812 06:17:27.624146 2600 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:27.624202 2603 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8454ff868eb3482789a5b8c737182fca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43949 } }
I20260812 06:17:27.624545 2603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8454ff868eb3482789a5b8c737182fca. Latest consensus state: current_term: 1 leader_uuid: "8454ff868eb3482789a5b8c737182fca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8454ff868eb3482789a5b8c737182fca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43949 } } }
I20260812 06:17:27.624634 2603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:27.624814 2605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8454ff868eb3482789a5b8c737182fca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8454ff868eb3482789a5b8c737182fca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43949 } } }
I20260812 06:17:27.624960 2605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:27.625583 2618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:27.626219 2618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:27.627954 2618 catalog_manager.cc:1347] Generated new cluster ID: c3e435fb6eda421287855a95f2001c9d
I20260812 06:17:27.628011 2618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:17:27 dist-test-slave-gw5c krb5kdc[2465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 06:17:27.636835 2610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:27.624403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59899 (local address 127.0.0.1:43949)
0812 06:17:27.624602 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:27.624612 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:27.625159 (+ 547us) server_negotiation.cc:407] Connection header received
0812 06:17:27.625296 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:27.625303 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:27.625367 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:27.626329 (+ 962us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:27.626437 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:27.627668 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:27.628752 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:27.629384 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:27.631156 (+ 1772us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:27.632467 (+ 1311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:27.632471 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:27.632471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:27.632482 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:27.634936 (+ 2454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:27.635488 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:27.635492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:27.635492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:27.635622 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:27.635857 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:27.635858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:27.635858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:27.636170 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:27.636337 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:27.636449 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 06:17:27.636598 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":79,"threads_started":1}
I20260812 06:17:27.638052 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:27.638105 2618 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:27.638826 2618 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:27.648088 2610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:27.639685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38005 (local address 127.0.0.1:43949)
0812 06:17:27.639724 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:27.639726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:27.639849 (+ 123us) server_negotiation.cc:407] Connection header received
0812 06:17:27.639911 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:27.639912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:27.639935 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:27.639997 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:27.640666 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:27.641578 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:27.642668 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:27.642987 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:27.643050 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:27.644632 (+ 1582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:27.644633 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:27.644634 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:27.644642 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:27.646640 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:27.647075 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:27.647076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:27.647076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:27.647138 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:27.647344 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:27.647344 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:27.647345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:27.647500 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:27.647594 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:27.647902 (+ 308us) server_negotiation.cc:299] Negotiation successful
0812 06:17:27.647989 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:17:27.650535 2618 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8454ff868eb3482789a5b8c737182fca: Generated new TSK 0
I20260812 06:17:27.650801 2618 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:27.654915 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 2488
2026-08-12T06:17:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1611 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:27 dist-test-slave-gw5c krb5kdc[2650](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:27 dist-test-slave-gw5c krb5kdc[2650](info): set up 2 sockets
Aug 12 06:17:27 dist-test-slave-gw5c krb5kdc[2650](info): commencing operation
krb5kdc: starting...
W20260812 06:17:28.979344 707 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:29 dist-test-slave-gw5c krb5kdc[2650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:17:29.111068 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43977
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:29.200244 2666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:29.200547 2666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:29.200596 2666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:29.201887 2666 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:29.201982 2666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:29.202009 2666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:29.202032 2666 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:29.202062 2666 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:29.203920 2666 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:29.204355 2666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:29.204680 2666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:29.209841 2675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:29.209836 2674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:29.209836 2678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:29.210235 2666 server_base.cc:1034] running on GCE node
I20260812 06:17:29.210554 2666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:29.210884 2666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:29.212059 2666 hybrid_clock.cc:648] HybridClock initialized: now 1786515449212047 us; error 48 us; skew 500 ppm
Aug 12 06:17:29 dist-test-slave-gw5c krb5kdc[2650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515449, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:29.214633 2666 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:17:29.215296 2666 webserver.cc:460] Webserver started at http://127.0.0.1:35013/ using document root <none> and password file <none>
I20260812 06:17:29.215632 2666 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:29.215715 2666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:29.215893 2666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:29.217082 2666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "de51f7d35324485b972809e9a5297a89"
format_stamp: "Formatted at 2026-08-12 06:17:29 on dist-test-slave-gw5c"
server_key: "3dee9b42e280bc425ad3720cc4db13a0"
server_key_iv: "293c5a3bbe27a5d565685c96f581dd00"
server_key_version: "encryptionkey@0"
I20260812 06:17:29.217494 2666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "de51f7d35324485b972809e9a5297a89"
format_stamp: "Formatted at 2026-08-12 06:17:29 on dist-test-slave-gw5c"
server_key: "3dee9b42e280bc425ad3720cc4db13a0"
server_key_iv: "293c5a3bbe27a5d565685c96f581dd00"
server_key_version: "encryptionkey@0"
I20260812 06:17:29.219017 2666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:17:29.219969 2689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:29.220201 2666 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:17:29.220309 2666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "de51f7d35324485b972809e9a5297a89"
format_stamp: "Formatted at 2026-08-12 06:17:29 on dist-test-slave-gw5c"
server_key: "3dee9b42e280bc425ad3720cc4db13a0"
server_key_iv: "293c5a3bbe27a5d565685c96f581dd00"
server_key_version: "encryptionkey@0"
I20260812 06:17:29.220371 2666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:29.231302 2666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:29.233814 2666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:29.233965 2666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:29.238785 2666 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43977
I20260812 06:17:29.238843 2773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43977 every 8 connection(s)
I20260812 06:17:29.239295 2666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:29.240406 2774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:29.242821 2774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89: Bootstrap starting.
I20260812 06:17:29.243505 2774 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:29.243824 2774 log.cc:824] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:29.244624 2774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89: No bootstrap required, opened a new log
I20260812 06:17:29.246297 2774 raft_consensus.cc:348] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de51f7d35324485b972809e9a5297a89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43977 } }
I20260812 06:17:29.246449 2774 raft_consensus.cc:374] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:29.246474 2774 raft_consensus.cc:729] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de51f7d35324485b972809e9a5297a89, State: Initialized, Role: FOLLOWER
I20260812 06:17:29.246677 2774 consensus_queue.cc:260] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de51f7d35324485b972809e9a5297a89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43977 } }
I20260812 06:17:29.246778 2774 raft_consensus.cc:388] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:29.246824 2774 raft_consensus.cc:482] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:29.246878 2774 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:29.247560 2774 raft_consensus.cc:504] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de51f7d35324485b972809e9a5297a89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43977 } }
I20260812 06:17:29.247654 2774 leader_election.cc:302] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de51f7d35324485b972809e9a5297a89; no voters:
I20260812 06:17:29.247931 2774 leader_election.cc:288] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:29.247957 2780 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:29.247942 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 2666
I20260812 06:17:29.248087 2780 raft_consensus.cc:686] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [term 1 LEADER]: Becoming Leader. State: Replica: de51f7d35324485b972809e9a5297a89, State: Running, Role: LEADER
I20260812 06:17:29.248106 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:29.248176 2780 consensus_queue.cc:237] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de51f7d35324485b972809e9a5297a89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43977 } }
I20260812 06:17:29.248235 2774 sys_catalog.cc:564] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:29.248328 707 external_mini_cluster.cc:1428] Setting key 17c4b168c8aa966870f95826eef1398a
I20260812 06:17:29.248651 2780 sys_catalog.cc:455] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader de51f7d35324485b972809e9a5297a89. Latest consensus state: current_term: 1 leader_uuid: "de51f7d35324485b972809e9a5297a89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de51f7d35324485b972809e9a5297a89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43977 } } }
I20260812 06:17:29.248725 2780 sys_catalog.cc:458] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:29.248850 2783 sys_catalog.cc:455] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de51f7d35324485b972809e9a5297a89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de51f7d35324485b972809e9a5297a89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43977 } } }
I20260812 06:17:29.248932 2783 sys_catalog.cc:458] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89 [sys.catalog]: This master's current role is: LEADER
W20260812 06:17:29.250687 2806 catalog_manager.cc:1558] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:17:29.250748 2806 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:17:29.250794 2786 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:29.250931 2786 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:29.252700 2786 catalog_manager.cc:1347] Generated new cluster ID: 0be3b2a0e3b2411aa3f79de07a59f016
I20260812 06:17:29.252791 2786 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:29.254626 2788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:29.248831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48613 (local address 127.0.0.1:43977)
0812 06:17:29.249069 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:29.249080 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:29.249574 (+ 494us) server_negotiation.cc:407] Connection header received
0812 06:17:29.249771 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:29.249777 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:29.249842 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:29.249989 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:29.250230 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:29.251305 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:29.252275 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:29.252920 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:29.253041 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:29.253870 (+ 829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:29.253876 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:29.253876 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:29.254103 (+ 227us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:29.254143 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:29.254160 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:29.254233 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:29.254313 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 06:17:29.254383 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":97,"threads_started":1}
I20260812 06:17:29.260579 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:29.266762 2788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:29.262205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54205 (local address 127.0.0.1:43977)
0812 06:17:29.262251 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:29.262254 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:29.262405 (+ 151us) server_negotiation.cc:407] Connection header received
0812 06:17:29.262459 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:29.262461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:29.262472 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:29.262535 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:29.262779 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:29.263916 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:29.265158 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:29.265529 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:29.265608 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:29.266395 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:29.266396 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:29.266397 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:29.266402 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:29.266420 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:29.266425 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:29.266485 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:29.266546 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 06:17:29.266581 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:17:29.270599 2786 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:29.271356 2786 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:29.283614 2786 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de51f7d35324485b972809e9a5297a89: Generated new TSK 0
I20260812 06:17:29.283914 2786 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:29.287168 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 2666
2026-08-12T06:17:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1630 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:29 dist-test-slave-gw5c krb5kdc[2820](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:29 dist-test-slave-gw5c krb5kdc[2820](info): set up 2 sockets
Aug 12 06:17:29 dist-test-slave-gw5c krb5kdc[2820](info): commencing operation
krb5kdc: starting...
W20260812 06:17:30.598925 707 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:30 dist-test-slave-gw5c krb5kdc[2820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:17:30.728118 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36911
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36911
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:30.815547 2843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:30.815791 2843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:30.815819 2843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:30.817109 2843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:30.817175 2843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:30.817193 2843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:30.817214 2843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:30.817229 2843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:30.818861 2843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36911
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:30.819180 2843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:30.819500 2843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:30.824616 2850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:30.824572 2851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:30.824572 2856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:30.824877 2843 server_base.cc:1034] running on GCE node
I20260812 06:17:30.825173 2843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:30.825526 2843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:30.826685 2843 hybrid_clock.cc:648] HybridClock initialized: now 1786515450826666 us; error 38 us; skew 500 ppm
Aug 12 06:17:30 dist-test-slave-gw5c krb5kdc[2820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515450, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:30.829465 2843 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:17:30.830010 2843 webserver.cc:460] Webserver started at http://127.0.0.1:38985/ using document root <none> and password file <none>
I20260812 06:17:30.830274 2843 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:30.830327 2843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:30.830514 2843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:30.831756 2843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "bf6776206c2b413d94180e9c10720b66"
format_stamp: "Formatted at 2026-08-12 06:17:30 on dist-test-slave-gw5c"
server_key: "c9fe43323899890b77c3889064ec773a"
server_key_iv: "1839f070162911bdad4b7d6da43602c6"
server_key_version: "encryptionkey@0"
I20260812 06:17:30.832156 2843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "bf6776206c2b413d94180e9c10720b66"
format_stamp: "Formatted at 2026-08-12 06:17:30 on dist-test-slave-gw5c"
server_key: "c9fe43323899890b77c3889064ec773a"
server_key_iv: "1839f070162911bdad4b7d6da43602c6"
server_key_version: "encryptionkey@0"
I20260812 06:17:30.833662 2843 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 06:17:30.834565 2873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:30.834781 2843 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:30.834867 2843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "bf6776206c2b413d94180e9c10720b66"
format_stamp: "Formatted at 2026-08-12 06:17:30 on dist-test-slave-gw5c"
server_key: "c9fe43323899890b77c3889064ec773a"
server_key_iv: "1839f070162911bdad4b7d6da43602c6"
server_key_version: "encryptionkey@0"
I20260812 06:17:30.834928 2843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:30.838351 2843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:30.840587 2843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:30.840708 2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:30.845212 2843 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36911
I20260812 06:17:30.845247 2947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36911 every 8 connection(s)
I20260812 06:17:30.845633 2843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:30.846642 2948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:30.850421 2948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66: Bootstrap starting.
I20260812 06:17:30.851046 2948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:30.851323 2948 log.cc:824] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:30.852240 2948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66: No bootstrap required, opened a new log
I20260812 06:17:30.853994 2948 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6776206c2b413d94180e9c10720b66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36911 } }
I20260812 06:17:30.854159 2948 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:30.854183 2948 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf6776206c2b413d94180e9c10720b66, State: Initialized, Role: FOLLOWER
I20260812 06:17:30.854341 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 2843
I20260812 06:17:30.854367 2948 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6776206c2b413d94180e9c10720b66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36911 } }
I20260812 06:17:30.854488 2948 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:30.854509 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:30.854549 2948 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:30.854609 2948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:30.854756 707 external_mini_cluster.cc:1428] Setting key e3d4691812b3a3215de9a2ba4ec65d10
I20260812 06:17:30.855736 2948 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6776206c2b413d94180e9c10720b66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36911 } }
I20260812 06:17:30.855890 2948 leader_election.cc:302] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf6776206c2b413d94180e9c10720b66; no voters:
I20260812 06:17:30.856071 2948 leader_election.cc:288] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:30.856132 2955 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:30.856307 2955 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [term 1 LEADER]: Becoming Leader. State: Replica: bf6776206c2b413d94180e9c10720b66, State: Running, Role: LEADER
I20260812 06:17:30.856388 2948 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:30.856428 2955 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6776206c2b413d94180e9c10720b66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36911 } }
I20260812 06:17:30.856915 2956 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf6776206c2b413d94180e9c10720b66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6776206c2b413d94180e9c10720b66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36911 } } }
I20260812 06:17:30.857002 2956 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:30.857226 2957 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf6776206c2b413d94180e9c10720b66. Latest consensus state: current_term: 1 leader_uuid: "bf6776206c2b413d94180e9c10720b66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6776206c2b413d94180e9c10720b66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36911 } } }
I20260812 06:17:30.857522 2963 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:30.857547 2957 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:30.858160 2963 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:30.858183 2952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:30.855790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46937 (local address 127.0.0.1:36911)
0812 06:17:30.856007 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:30.856019 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:30.856059 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:17:30.856197 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:30.856205 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:30.856238 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:30.857203 (+ 965us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:30.857565 (+ 362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:30.857568 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:30.857569 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:30.857572 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:30.857613 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:30.857631 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:30.857748 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:30.857943 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 06:17:30.857991 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":119,"threads_started":1}
I20260812 06:17:30.859338 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:30.860164 2963 catalog_manager.cc:1347] Generated new cluster ID: 2cc3ac98d7494841b446747aa65a9d7e
I20260812 06:17:30.860229 2963 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:30.862159 2952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:30.861101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59221 (local address 127.0.0.1:36911)
0812 06:17:30.861155 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:30.861157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:30.861166 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:17:30.861188 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:30.861189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:30.861194 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:30.861260 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:30.861931 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:30.861933 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:30.861933 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:30.861939 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:30.861957 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:30.861962 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:30.862024 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:30.862074 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 06:17:30.862087 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 06:17:30.869302 2963 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:30.869511 2963 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:30.880664 2963 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf6776206c2b413d94180e9c10720b66: Generated new TSK 0
I20260812 06:17:30.880904 2963 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:30.885972 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 2843
2026-08-12T06:17:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1605 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:30 dist-test-slave-gw5c krb5kdc[2994](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:30 dist-test-slave-gw5c krb5kdc[2994](info): set up 2 sockets
Aug 12 06:17:30 dist-test-slave-gw5c krb5kdc[2994](info): commencing operation
krb5kdc: starting...
W20260812 06:17:32.226745 707 mini_kdc.cc:121] Time spent starting KDC: real 1.305s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:32 dist-test-slave-gw5c krb5kdc[2994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:17:32.366168 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33473
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33473
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:32.453631 3013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:32.453959 3013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:32.454006 3013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:32.455255 3013 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:32.455358 3013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:32.455386 3013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:32.455410 3013 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:32.455480 3013 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:32.457178 3013 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33473
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:32.457525 3013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:32.457804 3013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:32.463234 3025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:32.463268 3027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:32.463234 3024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:32.463701 3013 server_base.cc:1034] running on GCE node
I20260812 06:17:32.463972 3013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:32.464251 3013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:32.465415 3013 hybrid_clock.cc:648] HybridClock initialized: now 1786515452465396 us; error 35 us; skew 500 ppm
Aug 12 06:17:32 dist-test-slave-gw5c krb5kdc[2994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515452, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:32.468453 3013 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:17:32.468962 3013 webserver.cc:460] Webserver started at http://127.0.0.1:33645/ using document root <none> and password file <none>
I20260812 06:17:32.469225 3013 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:32.469273 3013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:32.469441 3013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:32.470615 3013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "19d72cad2f944e11b88aed63b436cbf9"
format_stamp: "Formatted at 2026-08-12 06:17:32 on dist-test-slave-gw5c"
server_key: "54464cd1b396caef21287272a3e19b23"
server_key_iv: "686ba271b7f345d79d542a8d5b686f6a"
server_key_version: "encryptionkey@0"
I20260812 06:17:32.471019 3013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "19d72cad2f944e11b88aed63b436cbf9"
format_stamp: "Formatted at 2026-08-12 06:17:32 on dist-test-slave-gw5c"
server_key: "54464cd1b396caef21287272a3e19b23"
server_key_iv: "686ba271b7f345d79d542a8d5b686f6a"
server_key_version: "encryptionkey@0"
I20260812 06:17:32.472615 3013 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:17:32.473479 3035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:32.473850 3013 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:32.473950 3013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "19d72cad2f944e11b88aed63b436cbf9"
format_stamp: "Formatted at 2026-08-12 06:17:32 on dist-test-slave-gw5c"
server_key: "54464cd1b396caef21287272a3e19b23"
server_key_iv: "686ba271b7f345d79d542a8d5b686f6a"
server_key_version: "encryptionkey@0"
I20260812 06:17:32.474032 3013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:32.487100 3013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:32.489639 3013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:32.489795 3013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:32.494197 3013 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33473
I20260812 06:17:32.494254 3116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33473 every 8 connection(s)
I20260812 06:17:32.494606 3013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:32.495628 3117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:32.498131 3117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9: Bootstrap starting.
I20260812 06:17:32.498716 3117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:32.499001 3117 log.cc:824] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:32.499759 3117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9: No bootstrap required, opened a new log
I20260812 06:17:32.501348 3117 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d72cad2f944e11b88aed63b436cbf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33473 } }
I20260812 06:17:32.501488 3117 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:32.501510 3117 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19d72cad2f944e11b88aed63b436cbf9, State: Initialized, Role: FOLLOWER
I20260812 06:17:32.501617 3117 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d72cad2f944e11b88aed63b436cbf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33473 } }
I20260812 06:17:32.501706 3117 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:32.501758 3117 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:32.501828 3117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:32.502403 3117 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d72cad2f944e11b88aed63b436cbf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33473 } }
I20260812 06:17:32.502523 3117 leader_election.cc:302] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19d72cad2f944e11b88aed63b436cbf9; no voters:
I20260812 06:17:32.502714 3117 leader_election.cc:288] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:32.502817 3121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:32.502971 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 3013
I20260812 06:17:32.503021 3117 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:32.503062 3121 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [term 1 LEADER]: Becoming Leader. State: Replica: 19d72cad2f944e11b88aed63b436cbf9, State: Running, Role: LEADER
I20260812 06:17:32.503116 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:32.503219 3121 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d72cad2f944e11b88aed63b436cbf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33473 } }
I20260812 06:17:32.503345 707 external_mini_cluster.cc:1428] Setting key 7e6c66fb99bce0c50b02585889cbb109
I20260812 06:17:32.503978 3124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19d72cad2f944e11b88aed63b436cbf9. Latest consensus state: current_term: 1 leader_uuid: "19d72cad2f944e11b88aed63b436cbf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d72cad2f944e11b88aed63b436cbf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33473 } } }
I20260812 06:17:32.504093 3124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:32.504115 3122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19d72cad2f944e11b88aed63b436cbf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d72cad2f944e11b88aed63b436cbf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33473 } } }
I20260812 06:17:32.504210 3122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:32.504364 3141 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:32.504942 3141 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:32.506721 3141 catalog_manager.cc:1347] Generated new cluster ID: 6504cd0f03d447ce910fda010dcb3ab2
I20260812 06:17:32.506778 3141 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:17:32 dist-test-slave-gw5c krb5kdc[2994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 06:17:32.514997 3135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:32.503906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:48483 (local address 127.0.0.1:33473)
0812 06:17:32.505004 (+ 1098us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:32.505015 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:32.505053 (+ 38us) server_negotiation.cc:407] Connection header received
0812 06:17:32.505177 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:32.505183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:32.505230 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:32.505376 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:32.506325 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:32.507373 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:32.508369 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:32.508835 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:32.508984 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:32.511565 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:32.511569 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:32.511569 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:32.511582 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:32.513321 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:32.513780 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:32.513784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:32.513785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:32.513894 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:32.514134 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:32.514135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:32.514135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:32.514407 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:32.514605 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:32.514696 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 06:17:32.514804 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":1048,"thread_start_us":95,"threads_started":1}
I20260812 06:17:32.516032 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:32.526721 3135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:32.519811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:42651 (local address 127.0.0.1:33473)
0812 06:17:32.519857 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:32.519859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:32.520049 (+ 190us) server_negotiation.cc:407] Connection header received
0812 06:17:32.520129 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:32.520131 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:32.520141 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:32.520199 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:32.520769 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:32.521366 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:32.522103 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:32.522364 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:32.522440 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:32.523794 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:32.523796 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:32.523796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:32.523804 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:32.525465 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:32.525864 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:32.525865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:32.525865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:32.525933 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:32.526160 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:32.526161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:32.526161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:32.526286 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:32.526412 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:32.526537 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 06:17:32.526602 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:17:32.534490 3141 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:32.535069 3141 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:32.543422 3141 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19d72cad2f944e11b88aed63b436cbf9: Generated new TSK 0
I20260812 06:17:32.543642 3141 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:32.552882 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 3013
W20260812 06:17:32.570199 2989 connection.cc:535] client connection to 127.0.0.1:33473 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33473): Connection reset by peer (error 104)
2026-08-12T06:17:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1663 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:32 dist-test-slave-gw5c krb5kdc[3164](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:32 dist-test-slave-gw5c krb5kdc[3164](info): set up 2 sockets
Aug 12 06:17:32 dist-test-slave-gw5c krb5kdc[3164](info): commencing operation
krb5kdc: starting...
W20260812 06:17:33.881649 707 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:33 dist-test-slave-gw5c krb5kdc[3164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:17:34.015317 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34749
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:34.105037 3189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:34.105280 3189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:34.105307 3189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:34.106559 3189 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:34.106626 3189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:34.106642 3189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:34.106654 3189 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:34.106666 3189 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:34.108426 3189 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34749
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:34.108750 3189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:34.109016 3189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:34.114199 3196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:34.114246 3199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:34.114203 3203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:34.114699 3189 server_base.cc:1034] running on GCE node
I20260812 06:17:34.115000 3189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:34.115345 3189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:34.116592 3189 hybrid_clock.cc:648] HybridClock initialized: now 1786515454116544 us; error 55 us; skew 500 ppm
Aug 12 06:17:34 dist-test-slave-gw5c krb5kdc[3164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515454, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:34.119601 3189 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:17:34.120254 3189 webserver.cc:460] Webserver started at http://127.0.0.1:39373/ using document root <none> and password file <none>
I20260812 06:17:34.120703 3189 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:34.120790 3189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:34.120955 3189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:34.122495 3189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "1c4a25be81f14d6485cb186af900d123"
format_stamp: "Formatted at 2026-08-12 06:17:34 on dist-test-slave-gw5c"
server_key: "5927e32fa71225ce4898ad14ac824387"
server_key_iv: "a86afd0e67d50faf61451bb2d3666047"
server_key_version: "encryptionkey@0"
I20260812 06:17:34.122938 3189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "1c4a25be81f14d6485cb186af900d123"
format_stamp: "Formatted at 2026-08-12 06:17:34 on dist-test-slave-gw5c"
server_key: "5927e32fa71225ce4898ad14ac824387"
server_key_iv: "a86afd0e67d50faf61451bb2d3666047"
server_key_version: "encryptionkey@0"
I20260812 06:17:34.124598 3189 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260812 06:17:34.125491 3212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:34.125737 3189 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:34.125859 3189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "1c4a25be81f14d6485cb186af900d123"
format_stamp: "Formatted at 2026-08-12 06:17:34 on dist-test-slave-gw5c"
server_key: "5927e32fa71225ce4898ad14ac824387"
server_key_iv: "a86afd0e67d50faf61451bb2d3666047"
server_key_version: "encryptionkey@0"
I20260812 06:17:34.125955 3189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:34.139927 3189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:34.142197 3189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:34.142403 3189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:34.147308 3189 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34749
I20260812 06:17:34.147364 3296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34749 every 8 connection(s)
I20260812 06:17:34.147785 3189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:34.148744 3298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:34.151216 3298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123: Bootstrap starting.
I20260812 06:17:34.151919 3298 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:34.151929 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 3189
I20260812 06:17:34.152060 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:34.152262 707 external_mini_cluster.cc:1428] Setting key 730dc9058d380fe462b2873e86a869ad
I20260812 06:17:34.152311 3298 log.cc:824] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:34.153218 3298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123: No bootstrap required, opened a new log
I20260812 06:17:34.155694 3298 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4a25be81f14d6485cb186af900d123" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34749 } }
I20260812 06:17:34.155893 3298 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:34.155931 3298 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c4a25be81f14d6485cb186af900d123, State: Initialized, Role: FOLLOWER
I20260812 06:17:34.156067 3298 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4a25be81f14d6485cb186af900d123" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34749 } }
I20260812 06:17:34.156158 3298 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:34.156189 3298 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:34.156227 3298 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:34.157027 3298 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4a25be81f14d6485cb186af900d123" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34749 } }
I20260812 06:17:34.157145 3298 leader_election.cc:302] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c4a25be81f14d6485cb186af900d123; no voters:
I20260812 06:17:34.157315 3298 leader_election.cc:288] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:34.157472 3309 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:34.157598 3298 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:34.157646 3309 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [term 1 LEADER]: Becoming Leader. State: Replica: 1c4a25be81f14d6485cb186af900d123, State: Running, Role: LEADER
I20260812 06:17:34.157734 3309 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4a25be81f14d6485cb186af900d123" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34749 } }
I20260812 06:17:34.158110 3310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c4a25be81f14d6485cb186af900d123" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4a25be81f14d6485cb186af900d123" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34749 } } }
I20260812 06:17:34.158211 3310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:34.158392 3311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c4a25be81f14d6485cb186af900d123. Latest consensus state: current_term: 1 leader_uuid: "1c4a25be81f14d6485cb186af900d123" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4a25be81f14d6485cb186af900d123" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34749 } } }
I20260812 06:17:34.158460 3311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:34.158689 3320 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:34.158725 3308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:34.152835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:49831 (local address 127.0.0.1:34749)
0812 06:17:34.153024 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:34.153033 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:34.153073 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:17:34.153592 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:34.153599 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:34.153652 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:34.153770 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:34.153999 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:34.154870 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:34.156053 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:34.156680 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:34.156803 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:34.157906 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:34.157911 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:34.157911 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:34.158132 (+ 221us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:34.158171 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:34.158189 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:34.158254 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:34.158468 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 06:17:34.158503 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":104,"threads_started":1}
I20260812 06:17:34.159806 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:34.159960 3320 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:34.161917 3320 catalog_manager.cc:1347] Generated new cluster ID: 0c3ec9c4b4974399822bd0bddc7277eb
I20260812 06:17:34.161988 3320 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:34.165369 3308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:34.161475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:46665 (local address 127.0.0.1:34749)
0812 06:17:34.161512 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:34.161513 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:34.161641 (+ 128us) server_negotiation.cc:407] Connection header received
0812 06:17:34.161735 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:34.161736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:34.161749 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:34.161812 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:34.162050 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:34.162805 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:34.163882 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:34.164183 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:34.164225 (+ 42us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:34.165079 (+ 854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:34.165081 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:34.165081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:34.165086 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:34.165101 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:34.165106 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:34.165140 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:34.165275 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 06:17:34.165288 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:17:34.187909 3320 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:34.188510 3320 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:34.201505 3320 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c4a25be81f14d6485cb186af900d123: Generated new TSK 0
I20260812 06:17:34.201779 3320 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:34.213631 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 3189
W20260812 06:17:34.235997 3161 connection.cc:535] client connection to 127.0.0.1:34749 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34749): Connection reset by peer (error 104)
2026-08-12T06:17:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1665 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:34 dist-test-slave-gw5c krb5kdc[3343](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:34 dist-test-slave-gw5c krb5kdc[3343](info): set up 2 sockets
Aug 12 06:17:34 dist-test-slave-gw5c krb5kdc[3343](info): commencing operation
krb5kdc: starting...
W20260812 06:17:35.516393 707 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:35 dist-test-slave-gw5c krb5kdc[3343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:17:35.650877 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40691
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40691
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:35.738190 3367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:35.738478 3367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:35.738523 3367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:35.739773 3367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:35.739856 3367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:35.739879 3367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:35.739902 3367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:35.739931 3367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:35.741467 3367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40691
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:35.741775 3367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:35.742022 3367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:35.747234 3376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:35.747258 3375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:35.747375 3378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:35.747648 3367 server_base.cc:1034] running on GCE node
I20260812 06:17:35.747977 3367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:35.748327 3367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:35.749539 3367 hybrid_clock.cc:648] HybridClock initialized: now 1786515455749501 us; error 83 us; skew 500 ppm
Aug 12 06:17:35 dist-test-slave-gw5c krb5kdc[3343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515455, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:35.752674 3367 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:17:35.753232 3367 webserver.cc:460] Webserver started at http://127.0.0.1:37395/ using document root <none> and password file <none>
I20260812 06:17:35.753482 3367 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:35.753556 3367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:35.753717 3367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:35.754909 3367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "564d4ad978184baf84f2a16176189f57"
format_stamp: "Formatted at 2026-08-12 06:17:35 on dist-test-slave-gw5c"
server_key: "8c227bb7377cf8d7e1ab2ef0c5742ab6"
server_key_iv: "ac11a8b6810621fc3fbf5b60b96f9a34"
server_key_version: "encryptionkey@0"
I20260812 06:17:35.755316 3367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "564d4ad978184baf84f2a16176189f57"
format_stamp: "Formatted at 2026-08-12 06:17:35 on dist-test-slave-gw5c"
server_key: "8c227bb7377cf8d7e1ab2ef0c5742ab6"
server_key_iv: "ac11a8b6810621fc3fbf5b60b96f9a34"
server_key_version: "encryptionkey@0"
I20260812 06:17:35.757090 3367 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260812 06:17:35.758034 3390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:35.758236 3367 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:35.758354 3367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "564d4ad978184baf84f2a16176189f57"
format_stamp: "Formatted at 2026-08-12 06:17:35 on dist-test-slave-gw5c"
server_key: "8c227bb7377cf8d7e1ab2ef0c5742ab6"
server_key_iv: "ac11a8b6810621fc3fbf5b60b96f9a34"
server_key_version: "encryptionkey@0"
I20260812 06:17:35.758440 3367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:35.762158 3367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:35.764786 3367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:35.764971 3367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:35.769845 3367 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40691
I20260812 06:17:35.769881 3460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40691 every 8 connection(s)
I20260812 06:17:35.770272 3367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:35.771260 3464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:35.773736 3464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57: Bootstrap starting.
I20260812 06:17:35.774343 3464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:35.774587 3464 log.cc:824] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:35.775326 3464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57: No bootstrap required, opened a new log
I20260812 06:17:35.777037 3464 raft_consensus.cc:348] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564d4ad978184baf84f2a16176189f57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40691 } }
I20260812 06:17:35.777186 3464 raft_consensus.cc:374] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:35.777210 3464 raft_consensus.cc:729] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 564d4ad978184baf84f2a16176189f57, State: Initialized, Role: FOLLOWER
I20260812 06:17:35.777359 3464 consensus_queue.cc:260] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564d4ad978184baf84f2a16176189f57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40691 } }
I20260812 06:17:35.777444 3464 raft_consensus.cc:388] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:35.777468 3464 raft_consensus.cc:482] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:35.777496 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 3367
I20260812 06:17:35.777531 3464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:35.777649 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:35.777834 707 external_mini_cluster.cc:1428] Setting key a608519d1d56d2fdcb8104daef5e009c
I20260812 06:17:35.778331 3464 raft_consensus.cc:504] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564d4ad978184baf84f2a16176189f57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40691 } }
I20260812 06:17:35.778463 3464 leader_election.cc:302] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 564d4ad978184baf84f2a16176189f57; no voters:
I20260812 06:17:35.778648 3464 leader_election.cc:288] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:35.778766 3474 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:35.778894 3474 raft_consensus.cc:686] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [term 1 LEADER]: Becoming Leader. State: Replica: 564d4ad978184baf84f2a16176189f57, State: Running, Role: LEADER
I20260812 06:17:35.779067 3464 sys_catalog.cc:564] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:35.779068 3474 consensus_queue.cc:237] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564d4ad978184baf84f2a16176189f57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40691 } }
I20260812 06:17:35.779822 3476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 564d4ad978184baf84f2a16176189f57. Latest consensus state: current_term: 1 leader_uuid: "564d4ad978184baf84f2a16176189f57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564d4ad978184baf84f2a16176189f57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40691 } } }
I20260812 06:17:35.780007 3476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:35.780294 3488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:35.780027 3475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "564d4ad978184baf84f2a16176189f57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564d4ad978184baf84f2a16176189f57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40691 } } }
I20260812 06:17:35.780803 3473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:35.778430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:46789 (local address 127.0.0.1:40691)
0812 06:17:35.778649 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:35.778660 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:35.778704 (+ 44us) server_negotiation.cc:407] Connection header received
0812 06:17:35.778838 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:35.778845 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:35.778879 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:35.779083 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:35.780133 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:35.780137 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:35.780137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:35.780143 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:35.780190 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:35.780206 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:35.780515 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:35.780549 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 06:17:35.780597 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":96,"threads_started":1}
I20260812 06:17:35.780901 3475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:35.780927 3488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:35.782369 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:35.782879 3488 catalog_manager.cc:1347] Generated new cluster ID: 69476b1e6d914add8a26b29532b35228
I20260812 06:17:35.782955 3488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:35.788751 3473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:35.787562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:50453 (local address 127.0.0.1:40691)
0812 06:17:35.787608 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:35.787611 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:35.787622 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:17:35.787651 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:35.787652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:35.787658 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:35.787735 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:35.788491 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:35.788492 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:35.788493 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:35.788497 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:35.788515 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:35.788521 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:35.788587 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:35.788640 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 06:17:35.788656 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:17:35.799765 3488 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:35.799979 3488 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:35.819320 3488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 564d4ad978184baf84f2a16176189f57: Generated new TSK 0
I20260812 06:17:35.819657 3488 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:35.821646 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 3367
2026-08-12T06:17:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1602 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:35 dist-test-slave-gw5c krb5kdc[3522](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:35 dist-test-slave-gw5c krb5kdc[3522](info): set up 2 sockets
Aug 12 06:17:35 dist-test-slave-gw5c krb5kdc[3522](info): commencing operation
krb5kdc: starting...
W20260812 06:17:37.114660 707 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:37 dist-test-slave-gw5c krb5kdc[3522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:17:37.250224 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35163
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:37.338572 3543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:37.338886 3543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:37.338934 3543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:37.340209 3543 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:37.340293 3543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:37.340322 3543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:37.340351 3543 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:37.340381 3543 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:37.341959 3543 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35163
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:37.342283 3543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:37.342540 3543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:37.347528 3551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:37.347543 3553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:37.347548 3550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:37.347719 3543 server_base.cc:1034] running on GCE node
I20260812 06:17:37.348050 3543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:37.348361 3543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:37.349570 3543 hybrid_clock.cc:648] HybridClock initialized: now 1786515457349544 us; error 36 us; skew 500 ppm
Aug 12 06:17:37 dist-test-slave-gw5c krb5kdc[3522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515457, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:37.352623 3543 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:17:37.353168 3543 webserver.cc:460] Webserver started at http://127.0.0.1:41859/ using document root <none> and password file <none>
I20260812 06:17:37.353426 3543 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:37.353500 3543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:37.353659 3543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:37.354823 3543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "a020d49c568d4a6d84ead4a6e191eff8"
format_stamp: "Formatted at 2026-08-12 06:17:37 on dist-test-slave-gw5c"
server_key: "693f1e44a03cba83b0dfe1a24a241cd6"
server_key_iv: "a1e11f5b5b20fa01ee20113cbb5bb45f"
server_key_version: "encryptionkey@0"
I20260812 06:17:37.355234 3543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "a020d49c568d4a6d84ead4a6e191eff8"
format_stamp: "Formatted at 2026-08-12 06:17:37 on dist-test-slave-gw5c"
server_key: "693f1e44a03cba83b0dfe1a24a241cd6"
server_key_iv: "a1e11f5b5b20fa01ee20113cbb5bb45f"
server_key_version: "encryptionkey@0"
I20260812 06:17:37.356956 3543 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:37.357897 3567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:37.358121 3543 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:37.358253 3543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "a020d49c568d4a6d84ead4a6e191eff8"
format_stamp: "Formatted at 2026-08-12 06:17:37 on dist-test-slave-gw5c"
server_key: "693f1e44a03cba83b0dfe1a24a241cd6"
server_key_iv: "a1e11f5b5b20fa01ee20113cbb5bb45f"
server_key_version: "encryptionkey@0"
I20260812 06:17:37.358340 3543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:37.371978 3543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:37.375133 3543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:37.375381 3543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:37.381930 3543 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35163
I20260812 06:17:37.381974 3642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35163 every 8 connection(s)
I20260812 06:17:37.382561 3543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:37.383733 3648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:37.387295 3648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8: Bootstrap starting.
I20260812 06:17:37.387471 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 3543
I20260812 06:17:37.387589 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:37.387784 707 external_mini_cluster.cc:1428] Setting key 4315346e8a1690a99af5cb88600e36fc
I20260812 06:17:37.388199 3648 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:37.388602 3648 log.cc:824] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:37.389508 3648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8: No bootstrap required, opened a new log
I20260812 06:17:37.392536 3648 raft_consensus.cc:348] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a020d49c568d4a6d84ead4a6e191eff8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35163 } }
I20260812 06:17:37.392825 3648 raft_consensus.cc:374] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:37.392889 3648 raft_consensus.cc:729] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a020d49c568d4a6d84ead4a6e191eff8, State: Initialized, Role: FOLLOWER
I20260812 06:17:37.393075 3648 consensus_queue.cc:260] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a020d49c568d4a6d84ead4a6e191eff8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35163 } }
I20260812 06:17:37.393196 3648 raft_consensus.cc:388] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:37.393268 3648 raft_consensus.cc:482] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:37.393344 3648 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:37.394260 3648 raft_consensus.cc:504] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a020d49c568d4a6d84ead4a6e191eff8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35163 } }
I20260812 06:17:37.394424 3648 leader_election.cc:302] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a020d49c568d4a6d84ead4a6e191eff8; no voters:
I20260812 06:17:37.394658 3648 leader_election.cc:288] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:37.394703 3654 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:37.394882 3654 raft_consensus.cc:686] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [term 1 LEADER]: Becoming Leader. State: Replica: a020d49c568d4a6d84ead4a6e191eff8, State: Running, Role: LEADER
I20260812 06:17:37.395015 3654 consensus_queue.cc:237] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a020d49c568d4a6d84ead4a6e191eff8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35163 } }
I20260812 06:17:37.395051 3648 sys_catalog.cc:564] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:37.395483 3658 sys_catalog.cc:455] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a020d49c568d4a6d84ead4a6e191eff8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a020d49c568d4a6d84ead4a6e191eff8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35163 } } }
I20260812 06:17:37.395566 3658 sys_catalog.cc:458] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:37.395764 3656 sys_catalog.cc:455] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a020d49c568d4a6d84ead4a6e191eff8. Latest consensus state: current_term: 1 leader_uuid: "a020d49c568d4a6d84ead4a6e191eff8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a020d49c568d4a6d84ead4a6e191eff8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35163 } } }
I20260812 06:17:37.395845 3656 sys_catalog.cc:458] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8 [sys.catalog]: This master's current role is: LEADER
Aug 12 06:17:37 dist-test-slave-gw5c krb5kdc[3522](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
W20260812 06:17:37.398092 3681 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:17:37.398152 3681 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:17:37.398262 3662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:37.398530 3662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:37.401631 3662 catalog_manager.cc:1347] Generated new cluster ID: 4a7f453bfe334753866c6db1c9bf4501
I20260812 06:17:37.401706 3662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:37.407723 3652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:37.388335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:39133 (local address 127.0.0.1:35163)
0812 06:17:37.388541 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:37.388551 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:37.388593 (+ 42us) server_negotiation.cc:407] Connection header received
0812 06:17:37.389220 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:37.389235 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:37.389303 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:37.389432 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:37.390267 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:37.391853 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:37.393009 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:37.393665 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:37.393797 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:37.397139 (+ 3342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:37.397144 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:37.397144 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:37.397159 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:37.405280 (+ 8121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:37.405957 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:37.405962 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:37.405962 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:37.406098 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:37.406386 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:37.406387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:37.406388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:37.406784 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:37.407032 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:37.407136 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 06:17:37.407256 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260812 06:17:37.411757 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:37.424789 3662 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:37.425606 3662 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:37.429502 3652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:37.413365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:60571 (local address 127.0.0.1:35163)
0812 06:17:37.413411 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:37.413413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:37.420049 (+ 6636us) server_negotiation.cc:407] Connection header received
0812 06:17:37.420176 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:37.420178 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:37.420193 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:37.420227 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:37.421182 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:37.422003 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:37.423110 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:37.423604 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:37.423662 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:37.425963 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:37.425964 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:37.425964 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:37.425973 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:37.427963 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:37.428480 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:37.428482 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:37.428482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:37.428548 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:37.428816 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:37.428817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:37.428818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:37.428963 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:37.429045 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:37.429329 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 06:17:37.429405 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:17:37.429970 3662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a020d49c568d4a6d84ead4a6e191eff8: Generated new TSK 0
I20260812 06:17:37.430213 3662 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:37.436620 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 3543
W20260812 06:17:37.459280 3520 connection.cc:535] client connection to 127.0.0.1:35163 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35163): Connection reset by peer (error 104)
2026-08-12T06:17:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1620 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:37 dist-test-slave-gw5c krb5kdc[3704](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:37 dist-test-slave-gw5c krb5kdc[3704](info): set up 2 sockets
Aug 12 06:17:37 dist-test-slave-gw5c krb5kdc[3704](info): commencing operation
krb5kdc: starting...
W20260812 06:17:38.726023 707 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:38 dist-test-slave-gw5c krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:17:38.860458 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43213
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:38.953497 3727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:38.953867 3727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:38.953902 3727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:38.956363 3727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:38.956468 3727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:38.956487 3727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:38.956501 3727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:38.956516 3727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:38.958366 3727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43213
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:38.958623 3727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:38.958827 3727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:38.964136 3740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:38.964129 3742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:38.964136 3739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:38.964509 3727 server_base.cc:1034] running on GCE node
I20260812 06:17:38.964759 3727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:38.965029 3727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:38.966223 3727 hybrid_clock.cc:648] HybridClock initialized: now 1786515458966207 us; error 30 us; skew 500 ppm
Aug 12 06:17:38 dist-test-slave-gw5c krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515458, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:38.974817 3727 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:17:38.975502 3727 webserver.cc:460] Webserver started at http://127.0.0.1:34429/ using document root <none> and password file <none>
I20260812 06:17:38.975906 3727 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:38.976011 3727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:38.976387 3727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:38.977605 3727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "5e2e2a3a27de4583a601be024c078bb9"
format_stamp: "Formatted at 2026-08-12 06:17:38 on dist-test-slave-gw5c"
server_key: "048384b9bc0cb42662a058e18bff3d27"
server_key_iv: "2ef407fd9546fa98643c8ea93c5d74fe"
server_key_version: "encryptionkey@0"
I20260812 06:17:38.978003 3727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "5e2e2a3a27de4583a601be024c078bb9"
format_stamp: "Formatted at 2026-08-12 06:17:38 on dist-test-slave-gw5c"
server_key: "048384b9bc0cb42662a058e18bff3d27"
server_key_iv: "2ef407fd9546fa98643c8ea93c5d74fe"
server_key_version: "encryptionkey@0"
I20260812 06:17:38.980088 3727 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.003s
I20260812 06:17:38.981009 3753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:38.981191 3727 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:38.981304 3727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "5e2e2a3a27de4583a601be024c078bb9"
format_stamp: "Formatted at 2026-08-12 06:17:38 on dist-test-slave-gw5c"
server_key: "048384b9bc0cb42662a058e18bff3d27"
server_key_iv: "2ef407fd9546fa98643c8ea93c5d74fe"
server_key_version: "encryptionkey@0"
I20260812 06:17:38.981395 3727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:39.004947 3727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:39.006973 3727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:39.007158 3727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:39.011543 3727 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43213
I20260812 06:17:39.011610 3840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43213 every 8 connection(s)
I20260812 06:17:39.011998 3727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:39.013077 3844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:39.015681 3844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9: Bootstrap starting.
I20260812 06:17:39.016398 3844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:39.016727 3844 log.cc:824] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:39.017607 3844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9: No bootstrap required, opened a new log
I20260812 06:17:39.017683 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 3727
I20260812 06:17:39.017858 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:39.018065 707 external_mini_cluster.cc:1428] Setting key 2ea9ae9396269e0c488a72cba1d5170d
I20260812 06:17:39.020102 3844 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e2e2a3a27de4583a601be024c078bb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43213 } }
I20260812 06:17:39.020289 3844 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:39.020341 3844 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2e2a3a27de4583a601be024c078bb9, State: Initialized, Role: FOLLOWER
I20260812 06:17:39.020519 3844 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e2e2a3a27de4583a601be024c078bb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43213 } }
I20260812 06:17:39.020620 3844 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:39.020666 3844 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:39.020720 3844 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:39.021358 3844 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e2e2a3a27de4583a601be024c078bb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43213 } }
I20260812 06:17:39.021492 3844 leader_election.cc:302] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e2e2a3a27de4583a601be024c078bb9; no voters:
I20260812 06:17:39.021677 3844 leader_election.cc:288] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:39.021729 3850 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:39.021909 3850 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [term 1 LEADER]: Becoming Leader. State: Replica: 5e2e2a3a27de4583a601be024c078bb9, State: Running, Role: LEADER
I20260812 06:17:39.021957 3844 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:39.023427 3850 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e2e2a3a27de4583a601be024c078bb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43213 } }
I20260812 06:17:39.024187 3852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e2e2a3a27de4583a601be024c078bb9. Latest consensus state: current_term: 1 leader_uuid: "5e2e2a3a27de4583a601be024c078bb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e2e2a3a27de4583a601be024c078bb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43213 } } }
I20260812 06:17:39.024405 3852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:39.024231 3855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e2e2a3a27de4583a601be024c078bb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e2e2a3a27de4583a601be024c078bb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43213 } } }
I20260812 06:17:39.024602 3855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:39.024909 3849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:39.018726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:36613 (local address 127.0.0.1:43213)
0812 06:17:39.018977 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:39.018984 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:39.019012 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:17:39.019552 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:39.019559 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:39.019611 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:39.019730 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:39.020032 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:39.021352 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:39.022438 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:39.023170 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:39.023285 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:39.024122 (+ 837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:39.024126 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:39.024127 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:39.024354 (+ 227us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:39.024415 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:39.024432 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:39.024517 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:39.024718 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 06:17:39.024744 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":120,"threads_started":1}
W20260812 06:17:39.025178 3871 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:17:39.025270 3871 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:17:39.025365 3875 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:39.025569 3875 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:39.026046 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:39.027212 3875 catalog_manager.cc:1347] Generated new cluster ID: da23b8706845478b9473afdb3b3d1427
I20260812 06:17:39.027263 3875 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:39.031155 3849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:39.027692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:44363 (local address 127.0.0.1:43213)
0812 06:17:39.027726 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:39.027727 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:39.027736 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:17:39.027791 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:39.027792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:39.027802 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:39.027855 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:39.028006 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:39.028719 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:39.029724 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:39.030059 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:39.030136 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:39.030864 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:39.030865 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:39.030865 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:39.030870 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:39.030887 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:39.030892 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:39.030969 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:39.031040 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 06:17:39.031053 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:17:39.033694 3875 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:39.034248 3875 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:39.044359 3875 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e2e2a3a27de4583a601be024c078bb9: Generated new TSK 0
I20260812 06:17:39.044574 3875 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:39.050706 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 3727
W20260812 06:17:39.063846 3699 connection.cc:535] client connection to 127.0.0.1:43213 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43213): Connection reset by peer (error 104)
2026-08-12T06:17:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1604 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:39 dist-test-slave-gw5c krb5kdc[3892](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:39 dist-test-slave-gw5c krb5kdc[3892](info): set up 2 sockets
Aug 12 06:17:39 dist-test-slave-gw5c krb5kdc[3892](info): commencing operation
krb5kdc: starting...
W20260812 06:17:40.341801 707 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:40 dist-test-slave-gw5c krb5kdc[3892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:17:40.472674 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33889
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33889
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:40.558225 3910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:40.558504 3910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:40.558547 3910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:40.559794 3910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:40.559888 3910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:40.559924 3910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:40.559953 3910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:40.559985 3910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:40.561589 3910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33889
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:40.561913 3910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:40.562175 3910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:40.567183 3921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:40.567225 3910 server_base.cc:1034] running on GCE node
W20260812 06:17:40.567199 3918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:40.567189 3924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:40.567736 3910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:40.568112 3910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:40.569283 3910 hybrid_clock.cc:648] HybridClock initialized: now 1786515460569268 us; error 29 us; skew 500 ppm
Aug 12 06:17:40 dist-test-slave-gw5c krb5kdc[3892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515460, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:40.572283 3910 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:17:40.572786 3910 webserver.cc:460] Webserver started at http://127.0.0.1:38747/ using document root <none> and password file <none>
I20260812 06:17:40.573055 3910 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:40.573140 3910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:40.573304 3910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:40.574455 3910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "1c80a4efd5bf484789c385c8d4a0fb99"
format_stamp: "Formatted at 2026-08-12 06:17:40 on dist-test-slave-gw5c"
server_key: "9f02dec01c6efbde1ee58d8a5afd1f73"
server_key_iv: "bd1379834f517ae976723ddbb1e1f3b3"
server_key_version: "encryptionkey@0"
I20260812 06:17:40.574849 3910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "1c80a4efd5bf484789c385c8d4a0fb99"
format_stamp: "Formatted at 2026-08-12 06:17:40 on dist-test-slave-gw5c"
server_key: "9f02dec01c6efbde1ee58d8a5afd1f73"
server_key_iv: "bd1379834f517ae976723ddbb1e1f3b3"
server_key_version: "encryptionkey@0"
I20260812 06:17:40.576485 3910 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:17:40.577355 3936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:40.577589 3910 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:40.577695 3910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "1c80a4efd5bf484789c385c8d4a0fb99"
format_stamp: "Formatted at 2026-08-12 06:17:40 on dist-test-slave-gw5c"
server_key: "9f02dec01c6efbde1ee58d8a5afd1f73"
server_key_iv: "bd1379834f517ae976723ddbb1e1f3b3"
server_key_version: "encryptionkey@0"
I20260812 06:17:40.577786 3910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:40.581600 3910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:40.584237 3910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:40.584420 3910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:40.589160 3910 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33889
I20260812 06:17:40.589215 4013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33889 every 8 connection(s)
I20260812 06:17:40.589617 3910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:40.590723 4016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:40.593393 4016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99: Bootstrap starting.
I20260812 06:17:40.594056 4016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:40.594331 4016 log.cc:824] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:40.595552 4016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99: No bootstrap required, opened a new log
I20260812 06:17:40.597265 4016 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c80a4efd5bf484789c385c8d4a0fb99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33889 } }
I20260812 06:17:40.597435 4016 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:40.597460 4016 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c80a4efd5bf484789c385c8d4a0fb99, State: Initialized, Role: FOLLOWER
I20260812 06:17:40.597623 4016 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c80a4efd5bf484789c385c8d4a0fb99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33889 } }
I20260812 06:17:40.597718 4016 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:40.597743 4016 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:40.597774 4016 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:40.598380 4016 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c80a4efd5bf484789c385c8d4a0fb99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33889 } }
I20260812 06:17:40.598475 4016 leader_election.cc:302] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c80a4efd5bf484789c385c8d4a0fb99; no voters:
I20260812 06:17:40.598621 4016 leader_election.cc:288] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:40.598692 4019 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:40.598944 4016 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:40.599004 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 3910
I20260812 06:17:40.598996 4019 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [term 1 LEADER]: Becoming Leader. State: Replica: 1c80a4efd5bf484789c385c8d4a0fb99, State: Running, Role: LEADER
I20260812 06:17:40.599128 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:40.599133 4019 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c80a4efd5bf484789c385c8d4a0fb99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33889 } }
I20260812 06:17:40.599342 707 external_mini_cluster.cc:1428] Setting key b528f4ea3644d1f434cfa7a070d73559
I20260812 06:17:40.599665 4020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c80a4efd5bf484789c385c8d4a0fb99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c80a4efd5bf484789c385c8d4a0fb99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33889 } } }
I20260812 06:17:40.599766 4020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:40.600214 4032 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:40.600796 4032 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:40.600751 4022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c80a4efd5bf484789c385c8d4a0fb99. Latest consensus state: current_term: 1 leader_uuid: "1c80a4efd5bf484789c385c8d4a0fb99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c80a4efd5bf484789c385c8d4a0fb99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33889 } } }
I20260812 06:17:40.600847 4022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:40.602680 4032 catalog_manager.cc:1347] Generated new cluster ID: 0ffc36954a0a45ce8a0dca3cfba5f981
I20260812 06:17:40.602759 4032 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:40.603144 4046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:40.600708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:39231 (local address 127.0.0.1:33889)
0812 06:17:40.600888 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:40.600900 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:40.600939 (+ 39us) server_negotiation.cc:407] Connection header received
0812 06:17:40.601428 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:40.601437 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:40.601527 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:40.601706 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:40.602436 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:40.602439 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:40.602440 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:40.602451 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:40.602506 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:40.602518 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:40.602878 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:40.602911 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 06:17:40.602957 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260812 06:17:40.604195 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:40.607010 4046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:40.605855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.66:57411 (local address 127.0.0.1:33889)
0812 06:17:40.605906 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:40.605908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:40.606017 (+ 109us) server_negotiation.cc:407] Connection header received
0812 06:17:40.606050 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:40.606051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:40.606069 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:40.606139 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:40.606774 (+ 635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:40.606775 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:40.606775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:40.606781 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:40.606798 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:40.606804 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:40.606870 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:40.606921 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 06:17:40.606936 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:17:40.614033 4032 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:40.614256 4032 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:40.623004 4032 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c80a4efd5bf484789c385c8d4a0fb99: Generated new TSK 0
I20260812 06:17:40.623262 4032 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:40.629693 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 3910
2026-08-12T06:17:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1582 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:40 dist-test-slave-gw5c krb5kdc[4063](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:40 dist-test-slave-gw5c krb5kdc[4063](info): set up 2 sockets
Aug 12 06:17:40 dist-test-slave-gw5c krb5kdc[4063](info): commencing operation
krb5kdc: starting...
W20260812 06:17:41.926004 707 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:42 dist-test-slave-gw5c krb5kdc[4063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515462, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:17:42.077801 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:39223
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:39223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:42.169518 4086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:42.169762 4086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:42.169790 4086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:42.171059 4086 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:42.171113 4086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:42.171128 4086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:42.171140 4086 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:42.171154 4086 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:42.172878 4086 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:39223
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:39223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:42.173193 4086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:42.173456 4086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:42.178876 4096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:42.179001 4086 server_base.cc:1034] running on GCE node
W20260812 06:17:42.178841 4099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:42.178911 4095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:42.179368 4086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:42.179795 4086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:42.181034 4086 hybrid_clock.cc:648] HybridClock initialized: now 1786515462181005 us; error 57 us; skew 500 ppm
Aug 12 06:17:42 dist-test-slave-gw5c krb5kdc[4063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515462, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:42.184417 4086 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:17:42.184993 4086 webserver.cc:460] Webserver started at http://127.0.176.254:38487/ using document root <none> and password file <none>
I20260812 06:17:42.185248 4086 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:42.185325 4086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:42.185485 4086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:42.186646 4086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "4ed64ce59df8417e8760c879eaaa67f8"
format_stamp: "Formatted at 2026-08-12 06:17:42 on dist-test-slave-gw5c"
server_key: "656d7b52b9a6819a4566523850a6af2c"
server_key_iv: "6d315bbc5009db3f3df5b9fff7b9f512"
server_key_version: "encryptionkey@0"
I20260812 06:17:42.187057 4086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "4ed64ce59df8417e8760c879eaaa67f8"
format_stamp: "Formatted at 2026-08-12 06:17:42 on dist-test-slave-gw5c"
server_key: "656d7b52b9a6819a4566523850a6af2c"
server_key_iv: "6d315bbc5009db3f3df5b9fff7b9f512"
server_key_version: "encryptionkey@0"
I20260812 06:17:42.188788 4086 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 06:17:42.189685 4109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:42.189898 4086 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:42.190017 4086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "4ed64ce59df8417e8760c879eaaa67f8"
format_stamp: "Formatted at 2026-08-12 06:17:42 on dist-test-slave-gw5c"
server_key: "656d7b52b9a6819a4566523850a6af2c"
server_key_iv: "6d315bbc5009db3f3df5b9fff7b9f512"
server_key_version: "encryptionkey@0"
I20260812 06:17:42.190102 4086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:42.202762 4086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:42.205199 4086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:42.205400 4086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:42.209892 4086 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:39223
I20260812 06:17:42.209960 4198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:39223 every 8 connection(s)
I20260812 06:17:42.210337 4086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:42.211293 4199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:42.213747 4199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8: Bootstrap starting.
I20260812 06:17:42.214534 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 4086
I20260812 06:17:42.214682 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:42.214879 707 external_mini_cluster.cc:1428] Setting key 4f475178938cabb06f4c78127a8c8506
I20260812 06:17:42.215270 4199 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:42.215878 4199 log.cc:824] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:42.216789 4199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8: No bootstrap required, opened a new log
I20260812 06:17:42.219043 4199 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed64ce59df8417e8760c879eaaa67f8" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39223 } }
I20260812 06:17:42.219223 4199 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:42.219257 4199 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ed64ce59df8417e8760c879eaaa67f8, State: Initialized, Role: FOLLOWER
I20260812 06:17:42.219419 4199 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed64ce59df8417e8760c879eaaa67f8" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39223 } }
I20260812 06:17:42.219511 4199 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:42.219537 4199 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:42.219614 4199 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:42.220328 4199 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed64ce59df8417e8760c879eaaa67f8" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39223 } }
I20260812 06:17:42.220476 4199 leader_election.cc:302] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ed64ce59df8417e8760c879eaaa67f8; no voters:
I20260812 06:17:42.220681 4199 leader_election.cc:288] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:42.220825 4205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:42.220993 4199 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:42.221040 4205 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [term 1 LEADER]: Becoming Leader. State: Replica: 4ed64ce59df8417e8760c879eaaa67f8, State: Running, Role: LEADER
I20260812 06:17:42.221223 4205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed64ce59df8417e8760c879eaaa67f8" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39223 } }
I20260812 06:17:42.221582 4206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ed64ce59df8417e8760c879eaaa67f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed64ce59df8417e8760c879eaaa67f8" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39223 } } }
I20260812 06:17:42.221664 4206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:42.221824 4209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ed64ce59df8417e8760c879eaaa67f8. Latest consensus state: current_term: 1 leader_uuid: "4ed64ce59df8417e8760c879eaaa67f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed64ce59df8417e8760c879eaaa67f8" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 39223 } } }
I20260812 06:17:42.221881 4209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:42.222318 4217 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 06:17:42 dist-test-slave-gw5c krb5kdc[4063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515462, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:42.222826 4217 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:42.224588 4217 catalog_manager.cc:1347] Generated new cluster ID: 9c33b7ebf33e4a3db96e6fb2591f9ab1
I20260812 06:17:42.224642 4217 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:42.229435 4217 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:42.230145 4217 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:42.230566 4203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:42.215451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50145 (local address 127.0.176.254:39223)
0812 06:17:42.215633 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:42.215643 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:42.215674 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:17:42.216310 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:42.216320 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:42.216398 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:42.216523 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:42.217397 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:42.218281 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:42.219477 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:42.220005 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:42.220090 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:42.223464 (+ 3374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:42.223468 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:42.223469 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:42.223480 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:42.228528 (+ 5048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:42.229258 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:42.229261 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:42.229262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:42.229378 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:42.229661 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:42.229662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:42.229663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:42.229942 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:42.230105 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:42.230260 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 06:17:42.230363 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":91,"threads_started":1}
I20260812 06:17:42.231642 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:42.232491 4217 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ed64ce59df8417e8760c879eaaa67f8: Generated new TSK 0
I20260812 06:17:42.232650 4217 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:42.239483 4203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:42.233186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35705 (local address 127.0.176.254:39223)
0812 06:17:42.233222 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:42.233224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:42.233351 (+ 127us) server_negotiation.cc:407] Connection header received
0812 06:17:42.233435 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:42.233436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:42.233446 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:42.233500 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:42.234023 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:42.234593 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:42.235308 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:42.235645 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:42.235723 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:42.236947 (+ 1224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:42.236948 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:42.236948 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:42.236955 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:42.238258 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:42.238635 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:42.238637 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:42.238637 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:42.238692 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:42.238930 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:42.238931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:42.238932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:42.239051 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:42.239165 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:42.239288 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 06:17:42.239355 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:17:42.241920 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 4086
W20260812 06:17:42.260550 4060 connection.cc:535] client connection to 127.0.176.254:39223 recv error: Network error: failed to read from TLS socket (remote: 127.0.176.254:39223): Connection reset by peer (error 104)
2026-08-12T06:17:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1614 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:42 dist-test-slave-gw5c krb5kdc[4242](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:42 dist-test-slave-gw5c krb5kdc[4242](info): set up 2 sockets
Aug 12 06:17:42 dist-test-slave-gw5c krb5kdc[4242](info): commencing operation
krb5kdc: starting...
W20260812 06:17:43.547305 707 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:43 dist-test-slave-gw5c krb5kdc[4242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:17:43.682489 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:40755
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:40755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:43.769942 4269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:43.770228 4269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:43.770700 4269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:43.772606 4269 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:43.772744 4269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:43.772773 4269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:43.772795 4269 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:43.772827 4269 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:43.774585 4269 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:40755
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:40755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:43.774893 4269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:43.775148 4269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:43.780246 4282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:43.780251 4284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:43.780372 4279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:43.780817 4269 server_base.cc:1034] running on GCE node
I20260812 06:17:43.781085 4269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:43.781387 4269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:43.782564 4269 hybrid_clock.cc:648] HybridClock initialized: now 1786515463782525 us; error 71 us; skew 500 ppm
Aug 12 06:17:43 dist-test-slave-gw5c krb5kdc[4242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515463, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:43.785681 4269 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:17:43.786176 4269 webserver.cc:460] Webserver started at http://127.0.176.254:39577/ using document root <none> and password file <none>
I20260812 06:17:43.786425 4269 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:43.786494 4269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:43.786648 4269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:43.787861 4269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "2c61c469be7b4802a9609d0fc0427beb"
format_stamp: "Formatted at 2026-08-12 06:17:43 on dist-test-slave-gw5c"
server_key: "9007655360e945649dbb7ec00d059771"
server_key_iv: "c65742e5c8ab5ccb8ffb0824ec387428"
server_key_version: "encryptionkey@0"
I20260812 06:17:43.788245 4269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "2c61c469be7b4802a9609d0fc0427beb"
format_stamp: "Formatted at 2026-08-12 06:17:43 on dist-test-slave-gw5c"
server_key: "9007655360e945649dbb7ec00d059771"
server_key_iv: "c65742e5c8ab5ccb8ffb0824ec387428"
server_key_version: "encryptionkey@0"
I20260812 06:17:43.789705 4269 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:17:43.790591 4294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:43.790813 4269 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:43.790930 4269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "2c61c469be7b4802a9609d0fc0427beb"
format_stamp: "Formatted at 2026-08-12 06:17:43 on dist-test-slave-gw5c"
server_key: "9007655360e945649dbb7ec00d059771"
server_key_iv: "c65742e5c8ab5ccb8ffb0824ec387428"
server_key_version: "encryptionkey@0"
I20260812 06:17:43.791010 4269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:43.812701 4269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:43.814956 4269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:43.815157 4269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:43.819478 4269 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:40755
I20260812 06:17:43.819504 4369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:40755 every 8 connection(s)
I20260812 06:17:43.819901 4269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:43.820880 4370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:43.823593 4370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb: Bootstrap starting.
I20260812 06:17:43.824275 4370 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:43.824582 4370 log.cc:824] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:43.825376 4370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb: No bootstrap required, opened a new log
I20260812 06:17:43.827085 4370 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c61c469be7b4802a9609d0fc0427beb" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40755 } }
I20260812 06:17:43.827235 4370 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:43.827258 4370 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c61c469be7b4802a9609d0fc0427beb, State: Initialized, Role: FOLLOWER
I20260812 06:17:43.827466 4370 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c61c469be7b4802a9609d0fc0427beb" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40755 } }
I20260812 06:17:43.827567 4370 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:43.827593 4370 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:43.827644 4370 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:43.828270 4370 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c61c469be7b4802a9609d0fc0427beb" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40755 } }
I20260812 06:17:43.828375 4370 leader_election.cc:302] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c61c469be7b4802a9609d0fc0427beb; no voters:
I20260812 06:17:43.828701 4370 leader_election.cc:288] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:43.828708 4377 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:43.828979 4377 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [term 1 LEADER]: Becoming Leader. State: Replica: 2c61c469be7b4802a9609d0fc0427beb, State: Running, Role: LEADER
I20260812 06:17:43.829113 4370 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:43.829128 4377 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c61c469be7b4802a9609d0fc0427beb" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40755 } }
I20260812 06:17:43.829331 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 4269
I20260812 06:17:43.829468 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:43.829698 707 external_mini_cluster.cc:1428] Setting key ba2d4f794ac36f4eb79154ea272fbd5b
I20260812 06:17:43.829811 4378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c61c469be7b4802a9609d0fc0427beb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c61c469be7b4802a9609d0fc0427beb" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40755 } } }
I20260812 06:17:43.829895 4378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:43.830214 4380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c61c469be7b4802a9609d0fc0427beb. Latest consensus state: current_term: 1 leader_uuid: "2c61c469be7b4802a9609d0fc0427beb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c61c469be7b4802a9609d0fc0427beb" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 40755 } } }
I20260812 06:17:43.830267 4390 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:43.830322 4380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:43.831377 4390 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:43.834257 4390 catalog_manager.cc:1347] Generated new cluster ID: 64786032a6b84e42b6de4b1bac8bf5b8
I20260812 06:17:43.834326 4390 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:43.836836 4401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:43.830722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44175 (local address 127.0.176.254:40755)
0812 06:17:43.831624 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:43.831636 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:43.831676 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:17:43.831807 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:43.831814 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:43.831874 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:43.832039 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:43.832305 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:43.833201 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:43.834474 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:43.835116 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:43.835224 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:43.836110 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:43.836114 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:43.836115 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:43.836326 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:43.836365 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:43.836380 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:43.836470 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:43.836593 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 06:17:43.836619 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":755,"thread_start_us":419,"threads_started":1}
I20260812 06:17:43.838172 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:43.844431 4401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:43.839953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41643 (local address 127.0.176.254:40755)
0812 06:17:43.840014 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:43.840016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:43.840114 (+ 98us) server_negotiation.cc:407] Connection header received
0812 06:17:43.840201 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:43.840202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:43.840212 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:43.840239 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:43.840427 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:43.841169 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:43.842178 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:43.842504 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:43.842542 (+ 38us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:43.844120 (+ 1578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:43.844123 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:43.844123 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:43.844129 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:43.844149 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:43.844155 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:43.844222 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:43.844325 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 06:17:43.844341 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:17:43.851502 4390 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:43.852351 4390 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:43.858999 4390 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c61c469be7b4802a9609d0fc0427beb: Generated new TSK 0
I20260812 06:17:43.859242 4390 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:43.867967 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 4269
W20260812 06:17:43.877866 4240 connection.cc:535] client connection to 127.0.176.254:40755 recv error: Network error: failed to read from TLS socket (remote: 127.0.176.254:40755): Connection reset by peer (error 104)
2026-08-12T06:17:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1616 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:43 dist-test-slave-gw5c krb5kdc[4414](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:43 dist-test-slave-gw5c krb5kdc[4414](info): set up 2 sockets
Aug 12 06:17:43 dist-test-slave-gw5c krb5kdc[4414](info): commencing operation
krb5kdc: starting...
W20260812 06:17:45.153520 707 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:45 dist-test-slave-gw5c krb5kdc[4414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:17:45.282208 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43137
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:34149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:43137
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:45.375875 4430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:45.376200 4430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:45.376248 4430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:45.378381 4430 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:45.378474 4430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:45.378500 4430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:45.378536 4430 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:45.378556 4430 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:45.381898 4430 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:34149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:43137
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:43137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:45.382231 4430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:45.382513 4430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:45.387697 4442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:45.387709 4437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:45.387933 4430 server_base.cc:1034] running on GCE node
W20260812 06:17:45.387732 4436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:45.388265 4430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:45.388598 4430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:45.389776 4430 hybrid_clock.cc:648] HybridClock initialized: now 1786515465389761 us; error 36 us; skew 500 ppm
Aug 12 06:17:45 dist-test-slave-gw5c krb5kdc[4414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515465, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:45.400512 4430 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:17:45.401095 4430 webserver.cc:460] Webserver started at http://127.0.176.254:41591/ using document root <none> and password file <none>
I20260812 06:17:45.401351 4430 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:45.401432 4430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:45.401595 4430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:45.402784 4430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "584b778f55df4d6ea6618bb750e97395"
format_stamp: "Formatted at 2026-08-12 06:17:45 on dist-test-slave-gw5c"
server_key: "0d2398357a596bcf3581ecf539afa86e"
server_key_iv: "b7ca79f9b21092722a14b38544a9cfb6"
server_key_version: "encryptionkey@0"
I20260812 06:17:45.403189 4430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "584b778f55df4d6ea6618bb750e97395"
format_stamp: "Formatted at 2026-08-12 06:17:45 on dist-test-slave-gw5c"
server_key: "0d2398357a596bcf3581ecf539afa86e"
server_key_iv: "b7ca79f9b21092722a14b38544a9cfb6"
server_key_version: "encryptionkey@0"
I20260812 06:17:45.405167 4430 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 06:17:45.406070 4450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:45.406293 4430 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:45.406410 4430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "584b778f55df4d6ea6618bb750e97395"
format_stamp: "Formatted at 2026-08-12 06:17:45 on dist-test-slave-gw5c"
server_key: "0d2398357a596bcf3581ecf539afa86e"
server_key_iv: "b7ca79f9b21092722a14b38544a9cfb6"
server_key_version: "encryptionkey@0"
I20260812 06:17:45.406503 4430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:45.410535 4430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:45.413306 4430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:45.413508 4430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:45.418288 4430 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:43137
I20260812 06:17:45.418324 4533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:43137 every 8 connection(s)
I20260812 06:17:45.418731 4430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:45.419932 4534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:45.422426 4534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395: Bootstrap starting.
I20260812 06:17:45.423076 4534 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:45.423328 4534 log.cc:824] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:45.424263 4534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395: No bootstrap required, opened a new log
I20260812 06:17:45.426026 4534 raft_consensus.cc:348] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "584b778f55df4d6ea6618bb750e97395" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43137 } }
I20260812 06:17:45.426182 4534 raft_consensus.cc:374] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:45.426205 4534 raft_consensus.cc:729] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 584b778f55df4d6ea6618bb750e97395, State: Initialized, Role: FOLLOWER
I20260812 06:17:45.426389 4534 consensus_queue.cc:260] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "584b778f55df4d6ea6618bb750e97395" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43137 } }
I20260812 06:17:45.426455 4534 raft_consensus.cc:388] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:45.426509 4534 raft_consensus.cc:482] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:45.426563 4534 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:45.427176 4534 raft_consensus.cc:504] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "584b778f55df4d6ea6618bb750e97395" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43137 } }
I20260812 06:17:45.427300 4534 leader_election.cc:302] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 584b778f55df4d6ea6618bb750e97395; no voters:
I20260812 06:17:45.427549 4534 leader_election.cc:288] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:45.427639 4540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:45.427825 4540 raft_consensus.cc:686] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [term 1 LEADER]: Becoming Leader. State: Replica: 584b778f55df4d6ea6618bb750e97395, State: Running, Role: LEADER
I20260812 06:17:45.427876 4534 sys_catalog.cc:564] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:45.427929 4540 consensus_queue.cc:237] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "584b778f55df4d6ea6618bb750e97395" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43137 } }
I20260812 06:17:45.428369 4543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 584b778f55df4d6ea6618bb750e97395. Latest consensus state: current_term: 1 leader_uuid: "584b778f55df4d6ea6618bb750e97395" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "584b778f55df4d6ea6618bb750e97395" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43137 } } }
I20260812 06:17:45.428469 4543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:45.428635 4541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "584b778f55df4d6ea6618bb750e97395" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "584b778f55df4d6ea6618bb750e97395" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 43137 } } }
I20260812 06:17:45.428965 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 4430
I20260812 06:17:45.429100 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:45.429327 707 external_mini_cluster.cc:1428] Setting key 2709b21f507341e51fabc6df13858244
I20260812 06:17:45.428725 4553 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:45.429983 4541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:45.429939 4553 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:45.431774 4553 catalog_manager.cc:1347] Generated new cluster ID: 3ab22f133a8d49c8a08776d82c47e382
I20260812 06:17:45.431828 4553 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:45.431839 4567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:45.429861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42989 (local address 127.0.176.254:43137)
0812 06:17:45.430159 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:45.430169 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:45.430212 (+ 43us) server_negotiation.cc:407] Connection header received
0812 06:17:45.430379 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:45.430386 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:45.430419 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:45.430567 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:45.431340 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:45.431344 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:45.431344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:45.431348 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:45.431438 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:45.431456 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:45.431524 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:45.431602 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 06:17:45.431647 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":76,"threads_started":1}
I20260812 06:17:45.436985 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:45.440995 4567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:45.439748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55949 (local address 127.0.176.254:43137)
0812 06:17:45.439805 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:45.439807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:45.439919 (+ 112us) server_negotiation.cc:407] Connection header received
0812 06:17:45.440002 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:45.440003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:45.440009 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:45.440069 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:45.440737 (+ 668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:45.440738 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:45.440739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:45.440743 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:45.440767 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:45.440772 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:45.440830 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:45.440891 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 06:17:45.440905 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:17:45.442989 4553 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:45.443162 4553 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:45.446856 4553 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 584b778f55df4d6ea6618bb750e97395: Generated new TSK 0
I20260812 06:17:45.447057 4553 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:45.451066 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 4430
2026-08-12T06:17:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1585 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:45 dist-test-slave-gw5c krb5kdc[4587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:45 dist-test-slave-gw5c krb5kdc[4587](info): set up 2 sockets
Aug 12 06:17:45 dist-test-slave-gw5c krb5kdc[4587](info): commencing operation
krb5kdc: starting...
W20260812 06:17:46.746085 707 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:46 dist-test-slave-gw5c krb5kdc[4587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:17:46.882184 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:45157
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:46427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:45157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:46.968516 4607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:46.968747 4607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:46.968772 4607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:46.969894 4607 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:46.969934 4607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:46.969949 4607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:46.969962 4607 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:46.969974 4607 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:46.971477 4607 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:46427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:45157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:45157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:46.971698 4607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:46.971902 4607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:46.977396 4622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:46.977378 4616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:46.977382 4614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:46.977762 4607 server_base.cc:1034] running on GCE node
I20260812 06:17:46.978144 4607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:46.978459 4607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:46.979643 4607 hybrid_clock.cc:648] HybridClock initialized: now 1786515466979628 us; error 49 us; skew 500 ppm
Aug 12 06:17:46 dist-test-slave-gw5c krb5kdc[4587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515466, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:46.982635 4607 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:17:46.983302 4607 webserver.cc:460] Webserver started at http://127.0.176.254:40415/ using document root <none> and password file <none>
I20260812 06:17:46.983654 4607 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:46.983741 4607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:46.983911 4607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:46.985064 4607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "b3851cbba97e438f8001d4acc587ce40"
format_stamp: "Formatted at 2026-08-12 06:17:46 on dist-test-slave-gw5c"
server_key: "7466de3c72d816d9980a4fbc5ed172f6"
server_key_iv: "051c36b3c98413b939910d237513e2fb"
server_key_version: "encryptionkey@0"
I20260812 06:17:46.985468 4607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "b3851cbba97e438f8001d4acc587ce40"
format_stamp: "Formatted at 2026-08-12 06:17:46 on dist-test-slave-gw5c"
server_key: "7466de3c72d816d9980a4fbc5ed172f6"
server_key_iv: "051c36b3c98413b939910d237513e2fb"
server_key_version: "encryptionkey@0"
I20260812 06:17:46.987164 4607 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:17:46.988186 4631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:46.988386 4607 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:46.988507 4607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "b3851cbba97e438f8001d4acc587ce40"
format_stamp: "Formatted at 2026-08-12 06:17:46 on dist-test-slave-gw5c"
server_key: "7466de3c72d816d9980a4fbc5ed172f6"
server_key_iv: "051c36b3c98413b939910d237513e2fb"
server_key_version: "encryptionkey@0"
I20260812 06:17:46.988588 4607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:47.013674 4607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:47.015712 4607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:47.015892 4607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:47.020998 4607 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:45157
I20260812 06:17:47.021035 4712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:45157 every 8 connection(s)
I20260812 06:17:47.021430 4607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:47.022342 4714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:47.024812 4714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40: Bootstrap starting.
I20260812 06:17:47.025452 4714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:47.025749 4714 log.cc:824] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:47.026491 4714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40: No bootstrap required, opened a new log
I20260812 06:17:47.028249 4714 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3851cbba97e438f8001d4acc587ce40" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 45157 } }
I20260812 06:17:47.028402 4714 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:47.028456 4714 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3851cbba97e438f8001d4acc587ce40, State: Initialized, Role: FOLLOWER
I20260812 06:17:47.028618 4714 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3851cbba97e438f8001d4acc587ce40" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 45157 } }
I20260812 06:17:47.028709 4714 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:47.028750 4714 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:47.028825 4714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:47.028831 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 4607
I20260812 06:17:47.028963 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:47.029176 707 external_mini_cluster.cc:1428] Setting key 5e4cf41658f23cf3b220659674fb58dc
I20260812 06:17:47.029618 4714 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3851cbba97e438f8001d4acc587ce40" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 45157 } }
I20260812 06:17:47.029743 4714 leader_election.cc:302] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3851cbba97e438f8001d4acc587ce40; no voters:
I20260812 06:17:47.029940 4714 leader_election.cc:288] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:47.029973 4723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:47.030125 4723 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [term 1 LEADER]: Becoming Leader. State: Replica: b3851cbba97e438f8001d4acc587ce40, State: Running, Role: LEADER
I20260812 06:17:47.030205 4714 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:47.030217 4723 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3851cbba97e438f8001d4acc587ce40" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 45157 } }
I20260812 06:17:47.030664 4723 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3851cbba97e438f8001d4acc587ce40. Latest consensus state: current_term: 1 leader_uuid: "b3851cbba97e438f8001d4acc587ce40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3851cbba97e438f8001d4acc587ce40" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 45157 } } }
I20260812 06:17:47.030740 4723 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:47.031028 4735 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:47.031601 4735 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:47.031667 4724 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3851cbba97e438f8001d4acc587ce40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3851cbba97e438f8001d4acc587ce40" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 45157 } } }
I20260812 06:17:47.031749 4724 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:47.033346 4735 catalog_manager.cc:1347] Generated new cluster ID: 335cff2cf39440a08b992d983dbaa665
I20260812 06:17:47.033403 4735 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:17:47 dist-test-slave-gw5c krb5kdc[4587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:47.043476 4719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:47.029752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48161 (local address 127.0.176.254:45157)
0812 06:17:47.029964 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:47.029975 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:47.030014 (+ 39us) server_negotiation.cc:407] Connection header received
0812 06:17:47.030141 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:47.030148 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:47.030205 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:47.030390 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:47.031346 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:47.032804 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:47.033939 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:47.034563 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:47.034660 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:47.038024 (+ 3364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:47.038029 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:47.038030 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:47.038046 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:47.041127 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:47.041646 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:47.041649 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:47.041650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:47.041770 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:47.042120 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:47.042120 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:47.042121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:47.042469 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:47.042630 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:47.043034 (+ 404us) server_negotiation.cc:299] Negotiation successful
0812 06:17:47.043192 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":107,"threads_started":1}
I20260812 06:17:47.044839 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:47.054425 4719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:47.046338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53249 (local address 127.0.176.254:45157)
0812 06:17:47.046375 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:47.046377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:47.046492 (+ 115us) server_negotiation.cc:407] Connection header received
0812 06:17:47.046578 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:47.046578 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:47.046587 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:47.046613 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:47.047284 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:47.048080 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:47.049088 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:47.049398 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:47.049435 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:47.051017 (+ 1582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:47.051018 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:47.051019 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:47.051026 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:47.053116 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:47.053543 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:47.053544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:47.053544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:47.053599 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:47.053791 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:47.053792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:47.053792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:47.053923 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:47.054029 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:47.054226 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 06:17:47.054321 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:17:47.061383 4735 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:47.062119 4735 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:47.064380 4735 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3851cbba97e438f8001d4acc587ce40: Generated new TSK 0
I20260812 06:17:47.064575 4735 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:47.070374 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 4607
2026-08-12T06:17:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1630 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:47 dist-test-slave-gw5c krb5kdc[4764](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:47 dist-test-slave-gw5c krb5kdc[4764](info): set up 2 sockets
Aug 12 06:17:47 dist-test-slave-gw5c krb5kdc[4764](info): commencing operation
krb5kdc: starting...
W20260812 06:17:48.380709 707 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:48 dist-test-slave-gw5c krb5kdc[4764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:17:48.512041 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:35789
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:43865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:35789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:48.599545 4789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:48.599781 4789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:48.599808 4789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:48.601161 4789 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:48.601215 4789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:48.601230 4789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:48.601243 4789 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:48.601256 4789 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:48.602846 4789 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:43865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:35789
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:35789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4789
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:48.603147 4789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:48.603420 4789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:48.608768 4804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:48.608768 4799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:48.608791 4802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:48.608958 4789 server_base.cc:1034] running on GCE node
I20260812 06:17:48.609320 4789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:48.609647 4789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:48.610834 4789 hybrid_clock.cc:648] HybridClock initialized: now 1786515468610818 us; error 47 us; skew 500 ppm
Aug 12 06:17:48 dist-test-slave-gw5c krb5kdc[4764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515468, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:48.613890 4789 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:17:48.614400 4789 webserver.cc:460] Webserver started at http://127.0.176.254:43239/ using document root <none> and password file <none>
I20260812 06:17:48.614645 4789 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:48.614714 4789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:48.614876 4789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:48.616070 4789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "c9a26dda0dcf4db38eafd6ea328e3798"
format_stamp: "Formatted at 2026-08-12 06:17:48 on dist-test-slave-gw5c"
server_key: "ae023655e80a1408779551959a4c9c8d"
server_key_iv: "ba96868678d30ff50d8f7a1bf763b19d"
server_key_version: "encryptionkey@0"
I20260812 06:17:48.616484 4789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "c9a26dda0dcf4db38eafd6ea328e3798"
format_stamp: "Formatted at 2026-08-12 06:17:48 on dist-test-slave-gw5c"
server_key: "ae023655e80a1408779551959a4c9c8d"
server_key_iv: "ba96868678d30ff50d8f7a1bf763b19d"
server_key_version: "encryptionkey@0"
I20260812 06:17:48.617971 4789 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:17:48.618743 4820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:48.618925 4789 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:17:48.619052 4789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "c9a26dda0dcf4db38eafd6ea328e3798"
format_stamp: "Formatted at 2026-08-12 06:17:48 on dist-test-slave-gw5c"
server_key: "ae023655e80a1408779551959a4c9c8d"
server_key_iv: "ba96868678d30ff50d8f7a1bf763b19d"
server_key_version: "encryptionkey@0"
I20260812 06:17:48.619130 4789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:48.646267 4789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:48.648566 4789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:48.648764 4789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:48.653290 4789 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:35789
I20260812 06:17:48.653335 4892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:35789 every 8 connection(s)
I20260812 06:17:48.653777 4789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:48.654699 4896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:48.657142 4896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798: Bootstrap starting.
I20260812 06:17:48.657732 4896 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:48.657996 4896 log.cc:824] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:48.658599 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 4789
I20260812 06:17:48.658730 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:48.658824 4896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798: No bootstrap required, opened a new log
I20260812 06:17:48.658944 707 external_mini_cluster.cc:1428] Setting key 84281c7fc2203e225dbf7bbfb066b6a7
I20260812 06:17:48.661787 4896 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9a26dda0dcf4db38eafd6ea328e3798" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35789 } }
I20260812 06:17:48.662034 4896 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:48.662077 4896 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a26dda0dcf4db38eafd6ea328e3798, State: Initialized, Role: FOLLOWER
I20260812 06:17:48.662214 4896 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9a26dda0dcf4db38eafd6ea328e3798" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35789 } }
I20260812 06:17:48.662312 4896 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:48.662343 4896 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:48.662397 4896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:48.663211 4896 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9a26dda0dcf4db38eafd6ea328e3798" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35789 } }
I20260812 06:17:48.663365 4896 leader_election.cc:302] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9a26dda0dcf4db38eafd6ea328e3798; no voters:
I20260812 06:17:48.663651 4896 leader_election.cc:288] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:48.663697 4901 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:48.663902 4901 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [term 1 LEADER]: Becoming Leader. State: Replica: c9a26dda0dcf4db38eafd6ea328e3798, State: Running, Role: LEADER
I20260812 06:17:48.664040 4901 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9a26dda0dcf4db38eafd6ea328e3798" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35789 } }
I20260812 06:17:48.664350 4896 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:48.664772 4904 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9a26dda0dcf4db38eafd6ea328e3798. Latest consensus state: current_term: 1 leader_uuid: "c9a26dda0dcf4db38eafd6ea328e3798" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9a26dda0dcf4db38eafd6ea328e3798" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35789 } } }
I20260812 06:17:48.664862 4904 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:48.665194 4902 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9a26dda0dcf4db38eafd6ea328e3798" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9a26dda0dcf4db38eafd6ea328e3798" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 35789 } } }
I20260812 06:17:48.665213 4911 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:48.665235 4900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:48.659541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53115 (local address 127.0.176.254:35789)
0812 06:17:48.659764 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:48.659772 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:48.659799 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:17:48.660318 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:48.660325 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:48.660385 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:48.660503 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:48.660857 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:48.661765 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:48.662911 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:48.663431 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:48.663568 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:48.664328 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:48.664333 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:48.664334 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:48.664561 (+ 227us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:48.664593 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:48.664605 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:48.664684 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:48.664904 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 06:17:48.664990 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":128,"threads_started":1}
I20260812 06:17:48.665330 4902 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:48.666280 4911 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:48.666685 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:48.668326 4911 catalog_manager.cc:1347] Generated new cluster ID: 680004513b2941e2908c3370e9f9136a
I20260812 06:17:48.668394 4911 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:48.672549 4900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:48.668619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55883 (local address 127.0.176.254:35789)
0812 06:17:48.668661 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:48.668663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:48.668794 (+ 131us) server_negotiation.cc:407] Connection header received
0812 06:17:48.668908 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:48.668909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:48.668921 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:48.668955 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:48.669180 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:48.669945 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:48.671023 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:48.671329 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:48.671373 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:48.672268 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:48.672269 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:48.672269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:48.672276 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:48.672290 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:48.672295 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:48.672323 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:48.672431 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 06:17:48.672458 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:17:48.705605 4911 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:48.706415 4911 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:48.720347 4911 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9a26dda0dcf4db38eafd6ea328e3798: Generated new TSK 0
I20260812 06:17:48.720615 4911 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:48.732048 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 4789
2026-08-12T06:17:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1653 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:48 dist-test-slave-gw5c krb5kdc[4939](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:48 dist-test-slave-gw5c krb5kdc[4939](info): set up 2 sockets
Aug 12 06:17:48 dist-test-slave-gw5c krb5kdc[4939](info): commencing operation
krb5kdc: starting...
W20260812 06:17:50.035320 707 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:50 dist-test-slave-gw5c krb5kdc[4939](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:17:50.175329 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42227
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:37479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:42227
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:50.265851 4964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:50.266110 4964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:50.266136 4964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:50.267310 4964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:50.267352 4964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:50.267366 4964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:50.267379 4964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:50.267488 4964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:50.269109 4964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:37479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:42227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:42227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:50.269353 4964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:50.269554 4964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:50.274827 4972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:50.274811 4975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:50.274854 4973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:50.275151 4964 server_base.cc:1034] running on GCE node
I20260812 06:17:50.275492 4964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:50.275835 4964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:50.277166 4964 hybrid_clock.cc:648] HybridClock initialized: now 1786515470277190 us; error 110 us; skew 500 ppm
Aug 12 06:17:50 dist-test-slave-gw5c krb5kdc[4939](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515470, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:50.280771 4964 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:17:50.281255 4964 webserver.cc:460] Webserver started at http://127.0.176.254:43709/ using document root <none> and password file <none>
I20260812 06:17:50.281497 4964 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:50.281567 4964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:50.281857 4964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:50.283083 4964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "8a81e6b701a344548a9532768e1649b8"
format_stamp: "Formatted at 2026-08-12 06:17:50 on dist-test-slave-gw5c"
server_key: "321019e5dc125a9659ae5e9373e2d267"
server_key_iv: "61843e5e20941378e9126f4ece4c53e2"
server_key_version: "encryptionkey@0"
I20260812 06:17:50.283551 4964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "8a81e6b701a344548a9532768e1649b8"
format_stamp: "Formatted at 2026-08-12 06:17:50 on dist-test-slave-gw5c"
server_key: "321019e5dc125a9659ae5e9373e2d267"
server_key_iv: "61843e5e20941378e9126f4ece4c53e2"
server_key_version: "encryptionkey@0"
I20260812 06:17:50.285135 4964 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:50.286013 4985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:50.286217 4964 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:50.286331 4964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "8a81e6b701a344548a9532768e1649b8"
format_stamp: "Formatted at 2026-08-12 06:17:50 on dist-test-slave-gw5c"
server_key: "321019e5dc125a9659ae5e9373e2d267"
server_key_iv: "61843e5e20941378e9126f4ece4c53e2"
server_key_version: "encryptionkey@0"
I20260812 06:17:50.286423 4964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:50.290315 4964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:50.293035 4964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:50.293223 4964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:50.297755 4964 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:42227
I20260812 06:17:50.297791 5066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:42227 every 8 connection(s)
I20260812 06:17:50.298204 4964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:50.299543 5067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:50.302101 5067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8: Bootstrap starting.
I20260812 06:17:50.302631 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 4964
I20260812 06:17:50.302762 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:50.302980 707 external_mini_cluster.cc:1428] Setting key 183a33cff63870bc738474b959c8f84d
I20260812 06:17:50.302982 5067 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:50.303320 5067 log.cc:824] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:50.304250 5067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8: No bootstrap required, opened a new log
I20260812 06:17:50.306010 5071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:50.303608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40663 (local address 127.0.176.254:42227)
0812 06:17:50.303819 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:50.303827 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:50.303875 (+ 48us) server_negotiation.cc:407] Connection header received
0812 06:17:50.304555 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:50.304564 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:50.304598 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:50.304769 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:50.305513 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:50.305517 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:50.305517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:50.305522 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:50.305579 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:50.305595 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:50.305692 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:50.305733 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 06:17:50.305778 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":114,"threads_started":1}
I20260812 06:17:50.306915 5067 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a81e6b701a344548a9532768e1649b8" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42227 } }
I20260812 06:17:50.307111 5067 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:17:50.307160 5067 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a81e6b701a344548a9532768e1649b8, State: Initialized, Role: FOLLOWER
I20260812 06:17:50.307214 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:50.307294 5067 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a81e6b701a344548a9532768e1649b8" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42227 } }
I20260812 06:17:50.307431 5067 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:17:50.307480 5067 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:17:50.307536 5067 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:50.308192 5067 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a81e6b701a344548a9532768e1649b8" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42227 } }
I20260812 06:17:50.308320 5067 leader_election.cc:302] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a81e6b701a344548a9532768e1649b8; no voters:
I20260812 06:17:50.308514 5067 leader_election.cc:288] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:17:50.308562 5078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:50.308753 5078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [term 1 LEADER]: Becoming Leader. State: Replica: 8a81e6b701a344548a9532768e1649b8, State: Running, Role: LEADER
I20260812 06:17:50.308810 5067 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:50.308971 5078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a81e6b701a344548a9532768e1649b8" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42227 } }
I20260812 06:17:50.309358 5079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a81e6b701a344548a9532768e1649b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a81e6b701a344548a9532768e1649b8" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42227 } } }
I20260812 06:17:50.309470 5079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:50.309571 5082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a81e6b701a344548a9532768e1649b8. Latest consensus state: current_term: 1 leader_uuid: "8a81e6b701a344548a9532768e1649b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a81e6b701a344548a9532768e1649b8" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 42227 } } }
I20260812 06:17:50.309835 5082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:50.310009 5095 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:50.310236 5071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:50.308771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58183 (local address 127.0.176.254:42227)
0812 06:17:50.308809 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:50.308811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:50.308976 (+ 165us) server_negotiation.cc:407] Connection header received
0812 06:17:50.309004 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:50.309005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:50.309011 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:50.309381 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:50.309838 (+ 457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:50.309839 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:50.309840 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:17:50.309844 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:50.309860 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:17:50.309865 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:50.309927 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:50.310153 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 06:17:50.310167 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:17:50.310802 5095 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:50.312523 5095 catalog_manager.cc:1347] Generated new cluster ID: a273a9befd2a4056b8a07c8c08d3688a
I20260812 06:17:50.312579 5095 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:50.318435 5095 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:50.318656 5095 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:50.331317 5095 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a81e6b701a344548a9532768e1649b8: Generated new TSK 0
I20260812 06:17:50.331619 5095 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:17:50.341609 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 4964
2026-08-12T06:17:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1619 ms)
[----------] 18 tests from AuthTokenIssuingTest (29263 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:50 dist-test-slave-gw5c krb5kdc[5115](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:50 dist-test-slave-gw5c krb5kdc[5115](info): set up 2 sockets
Aug 12 06:17:50 dist-test-slave-gw5c krb5kdc[5115](info): commencing operation
krb5kdc: starting...
W20260812 06:17:51.671607 707 mini_kdc.cc:121] Time spent starting KDC: real 1.290s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:51 dist-test-slave-gw5c krb5kdc[5115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:17:51.810905 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:41089
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:33373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:41089,127.0.176.253:33145,127.0.176.252:36783
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:51.902592 5136 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:17:51.902877 5136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:51.902930 5136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:51.902976 5136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:51.904363 5136 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:51.904441 5136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:51.904467 5136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:51.904500 5136 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:51.904528 5136 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:51.906219 5136 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:33373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:41089,127.0.176.253:33145,127.0.176.252:36783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:41089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:51.906548 5136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:51.906802 5136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:51.912099 5144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:51.912101 5146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:51.912317 5136 server_base.cc:1034] running on GCE node
W20260812 06:17:51.912101 5150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:51.912675 5136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:51.913009 5136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:51.914211 5136 hybrid_clock.cc:648] HybridClock initialized: now 1786515471914199 us; error 34 us; skew 500 ppm
Aug 12 06:17:51 dist-test-slave-gw5c krb5kdc[5115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515471, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:51.917923 5136 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:17:51.918545 5136 webserver.cc:460] Webserver started at http://127.0.176.254:41391/ using document root <none> and password file <none>
I20260812 06:17:51.919194 5136 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:51.919355 5136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:51.919569 5136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:51.920811 5136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "7935772136a84ba8b546344c95d82cb4"
format_stamp: "Formatted at 2026-08-12 06:17:51 on dist-test-slave-gw5c"
server_key: "55e5143fd4ba584d2af426ec2b140eac"
server_key_iv: "7f7270271ab7ee4a446806ec795ea0cb"
server_key_version: "encryptionkey@0"
I20260812 06:17:51.921214 5136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "7935772136a84ba8b546344c95d82cb4"
format_stamp: "Formatted at 2026-08-12 06:17:51 on dist-test-slave-gw5c"
server_key: "55e5143fd4ba584d2af426ec2b140eac"
server_key_iv: "7f7270271ab7ee4a446806ec795ea0cb"
server_key_version: "encryptionkey@0"
I20260812 06:17:51.923071 5136 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 06:17:51.924146 5162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:51.924379 5136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:17:51.924501 5136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "7935772136a84ba8b546344c95d82cb4"
format_stamp: "Formatted at 2026-08-12 06:17:51 on dist-test-slave-gw5c"
server_key: "55e5143fd4ba584d2af426ec2b140eac"
server_key_iv: "7f7270271ab7ee4a446806ec795ea0cb"
server_key_version: "encryptionkey@0"
I20260812 06:17:51.924589 5136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:51.942911 5136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:51.945164 5136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:51.945365 5136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:51.950012 5136 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:41089
I20260812 06:17:51.950052 5244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:41089 every 8 connection(s)
I20260812 06:17:51.950454 5136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:51.952150 5245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:51.953970 5245 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:17:51.959233 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 5136
I20260812 06:17:51.959417 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:51.959627 707 external_mini_cluster.cc:1428] Setting key 7fcf3e15fe90726700de0cc6013e2486
Aug 12 06:17:51 dist-test-slave-gw5c krb5kdc[5115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515471, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:51.964951 5248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:51.954985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51480 (local address 127.0.176.254:41089)
0812 06:17:51.955230 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:51.955235 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:51.955283 (+ 48us) server_negotiation.cc:407] Connection header received
0812 06:17:51.956010 (+ 727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:51.956012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:51.956031 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:51.956116 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:51.956767 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:51.957663 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:51.958583 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:51.958904 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:51.959115 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:51.961435 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:51.961446 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:51.961446 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:51.961455 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:51.963104 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:51.963661 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:51.963664 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:51.963664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:51.963748 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:51.964032 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:51.964033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:51.964033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:51.964330 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:51.964399 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:51.964660 (+ 261us) server_negotiation.cc:299] Negotiation successful
0812 06:17:51.964764 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":132,"threads_started":1}
I20260812 06:17:51.965063 5247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:51.954874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:41089 (local address 127.0.0.1:51480)
0812 06:17:51.955141 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:51.955205 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:51.955857 (+ 652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:51.956181 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:51.956183 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:51.956473 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:51.956639 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:51.956643 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:51.957764 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:51.957765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:51.958504 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:51.958506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:51.959107 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:51.959108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:51.959168 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:51.959826 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:51.959835 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:51.961321 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:51.963200 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:51.963208 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:51.963211 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:51.963563 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:51.963826 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:51.963827 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:51.963828 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:51.963957 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:51.964422 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:51.964430 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:51.964520 (+ 90us) client_negotiation.cc:769] Sending connection context
0812 06:17:51.964630 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 06:17:51.964880 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":61,"thread_start_us":121,"threads_started":1}
I20260812 06:17:51.965934 5245 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:17:51.966387 5247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:51.966225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:33145 (local address 127.0.0.1:58172)
0812 06:17:51.966284 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:51.966343 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:33145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 06:17:51.966547 5167 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.176.253:33145: connect: Connection refused (error 111)
I20260812 06:17:51.967033 5247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:51.966919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:33145 (local address 127.0.0.1:58178)
0812 06:17:51.966969 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:51.967003 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:33145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 06:17:51.967191 5245 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.253:33145: Network error: Client connection negotiation failed: client connection to 127.0.176.253:33145: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.0.176.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.253.keytab.
Entry for principal kudu/127.0.176.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.253.keytab.
I20260812 06:17:51.988794 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.253:33145
--webserver_interface=127.0.176.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.253.keytab
--principal=kudu/127.0.176.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:33373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:41089,127.0.176.253:33145,127.0.176.252:36783
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:17:52.016471 5245 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } attempt: 1
I20260812 06:17:52.017568 5247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.017361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:33145 (local address 127.0.0.1:58182)
0812 06:17:52.017419 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.017485 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:33145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 06:17:52.018241 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.017897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:33145 (local address 127.0.0.1:58188)
0812 06:17:52.018145 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.018191 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:33145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":119,"threads_started":1}
W20260812 06:17:52.018471 5245 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.253:33145: Network error: Client connection negotiation failed: client connection to 127.0.176.253:33145: connect: Connection refused (error 111)
I20260812 06:17:52.086700 5245 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } attempt: 2
I20260812 06:17:52.087296 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.087130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:33145 (local address 127.0.0.1:58190)
0812 06:17:52.087209 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.087260 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:33145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 06:17:52.088133 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.087909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:33145 (local address 127.0.0.1:58194)
0812 06:17:52.087994 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.088073 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:33145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 06:17:52.088389 5245 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.253:33145: Network error: Client connection negotiation failed: client connection to 127.0.176.253:33145: connect: Connection refused (error 111)
W20260812 06:17:52.096000 5262 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:17:52.096254 5262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:52.096273 5262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:52.096329 5262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:52.097621 5262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:52.097682 5262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:52.097697 5262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:52.097710 5262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:52.097750 5262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:52.100088 5262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:33373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:41089,127.0.176.253:33145,127.0.176.252:36783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.253.keytab
--principal=kudu/127.0.176.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.253:33145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.176.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:52.100481 5262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:52.100764 5262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:52.105974 5272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:52.105974 5275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:52.105997 5271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:52.106293 5262 server_base.cc:1034] running on GCE node
I20260812 06:17:52.106590 5262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:52.106918 5262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:52.108078 5262 hybrid_clock.cc:648] HybridClock initialized: now 1786515472108064 us; error 32 us; skew 500 ppm
Aug 12 06:17:52 dist-test-slave-gw5c krb5kdc[5115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515472, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:52.111044 5262 init.cc:377] Logged in from keytab as kudu/127.0.176.253@KRBTEST.COM (short username kudu)
I20260812 06:17:52.111697 5262 webserver.cc:460] Webserver started at http://127.0.176.253:41383/ using document root <none> and password file <none>
I20260812 06:17:52.111974 5262 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:52.112049 5262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:52.112335 5262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:52.113562 5262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/data/instance:
uuid: "d82f4ad59f42479da34b712944084590"
format_stamp: "Formatted at 2026-08-12 06:17:52 on dist-test-slave-gw5c"
server_key: "cc475f3d0443f939a8559f07cf30254d"
server_key_iv: "960e3d271d36750fbcc8951815583560"
server_key_version: "encryptionkey@0"
I20260812 06:17:52.113974 5262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/wal/instance:
uuid: "d82f4ad59f42479da34b712944084590"
format_stamp: "Formatted at 2026-08-12 06:17:52 on dist-test-slave-gw5c"
server_key: "cc475f3d0443f939a8559f07cf30254d"
server_key_iv: "960e3d271d36750fbcc8951815583560"
server_key_version: "encryptionkey@0"
I20260812 06:17:52.116341 5262 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.004s
I20260812 06:17:52.117481 5284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:52.117816 5262 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:52.117965 5262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/wal
uuid: "d82f4ad59f42479da34b712944084590"
format_stamp: "Formatted at 2026-08-12 06:17:52 on dist-test-slave-gw5c"
server_key: "cc475f3d0443f939a8559f07cf30254d"
server_key_iv: "960e3d271d36750fbcc8951815583560"
server_key_version: "encryptionkey@0"
I20260812 06:17:52.118065 5262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:52.134150 5262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:52.136937 5262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:52.137141 5262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:52.141654 5262 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.253:33145
I20260812 06:17:52.141711 5362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.253:33145 every 8 connection(s)
I20260812 06:17:52.142130 5262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/data/info.pb
I20260812 06:17:52.143261 5363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:52.145025 5363 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:17:52.146725 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 5262
I20260812 06:17:52.146859 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-1/wal/instance
I20260812 06:17:52.147097 707 external_mini_cluster.cc:1428] Setting key e66d75172e69d313827fb52de51a0f67
Aug 12 06:17:52 dist-test-slave-gw5c krb5kdc[5115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515472, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.253@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.176.252@KRBTEST.COM; defaulting to no policy
I20260812 06:17:52.158238 5248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.145853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51494 (local address 127.0.176.254:41089)
0812 06:17:52.145940 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.145942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.146173 (+ 231us) server_negotiation.cc:407] Connection header received
0812 06:17:52.146893 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.146894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.146913 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.146993 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.148015 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.148560 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.150284 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.150534 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.150620 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.153848 (+ 3228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.153851 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.153851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.153867 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.156094 (+ 2227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.157051 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.157055 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.157055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.157145 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.157481 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.157482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.157482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.157622 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.157702 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.158023 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.158135 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 06:17:52.158480 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.145804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:41089 (local address 127.0.0.1:51494)
0812 06:17:52.146028 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.146077 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:52.146693 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:52.147096 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:52.147101 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:52.147564 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:52.147870 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.147877 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.148681 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.148682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.150023 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.150031 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.150712 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.150713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.150860 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.151945 (+ 1085us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:52.151956 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:52.153578 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:52.156419 (+ 2841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.156433 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.156437 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.156942 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.157229 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.157230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.157230 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.157358 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.157704 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:52.157713 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:52.157877 (+ 164us) client_negotiation.cc:769] Sending connection context
0812 06:17:52.157991 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 06:17:52.158185 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":128,"threads_started":1}
I20260812 06:17:52.159503 5363 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.252@KRBTEST.COM" created.
Aug 12 06:17:52 dist-test-slave-gw5c krb5kdc[5115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515472, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.253@KRBTEST.COM for kudu/127.0.176.253@KRBTEST.COM
I20260812 06:17:52.168145 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.160049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:33145 (local address 127.0.0.1:58208)
0812 06:17:52.160143 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.160156 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:52.160229 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:52.160491 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:52.160492 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:52.160675 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:52.160738 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.160740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.161639 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.161640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.162148 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.162149 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.162674 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.162675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.162742 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.163246 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:52.163252 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:52.164956 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:52.166945 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.166946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.166947 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.167123 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.167353 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.167354 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.167354 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.167444 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.167752 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:52.167752 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:52.167795 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 06:17:52.167885 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 06:17:52.168017 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 06:17:52.168372 5373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.160141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58208 (local address 127.0.176.253:33145)
0812 06:17:52.160340 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.160344 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.160372 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:17:52.160390 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.160391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.160402 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.160491 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.160826 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.161538 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.162247 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.162579 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.162674 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.165081 (+ 2407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.165093 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.165093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.165101 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.166840 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.167222 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.167227 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.167232 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.167284 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.167505 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.167506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.167506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.167671 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.167763 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.167920 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.168091 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":97,"server-negotiator.queue_time_us":167,"thread_start_us":104,"threads_started":1}
I20260812 06:17:52.169076 5363 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:17:52.169497 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.169362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:45962)
0812 06:17:52.169417 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.169473 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 06:17:52.169662 5294 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
I20260812 06:17:52.170171 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.170063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:45968)
0812 06:17:52.170121 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.170150 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 06:17:52.170370 5363 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:36783: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.252.keytab.
Entry for principal kudu/127.0.176.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.252.keytab.
I20260812 06:17:52.176926 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.252:36783
--webserver_interface=127.0.176.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.252.keytab
--principal=kudu/127.0.176.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:33373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:41089,127.0.176.253:33145,127.0.176.252:36783
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:17:52.179610 5245 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } attempt: 3
Aug 12 06:17:52 dist-test-slave-gw5c krb5kdc[5115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515471, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for kudu/127.0.176.253@KRBTEST.COM
I20260812 06:17:52.188042 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.180012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:33145 (local address 127.0.0.1:58224)
0812 06:17:52.180074 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.180091 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:52.180169 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:52.180342 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:52.180344 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:52.180556 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:52.180915 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.180918 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.181646 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.181647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.182220 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.182222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.182651 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.182652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.182741 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.183258 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:52.183262 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:52.185021 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:52.186814 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.186815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.186816 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.187020 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.187252 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.187253 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.187254 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.187321 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.187637 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:52.187639 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:52.187703 (+ 64us) client_negotiation.cc:769] Sending connection context
0812 06:17:52.187796 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 06:17:52.187922 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 06:17:52.188030 5373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.180091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58224 (local address 127.0.176.253:33145)
0812 06:17:52.180164 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.180166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.180178 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:17:52.180242 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.180243 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.180256 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.180335 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.181014 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.181557 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.182313 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.182562 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.182652 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.185132 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.185134 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.185134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.185143 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.186694 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.187114 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.187115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.187116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.187180 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.187427 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.187428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.187428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.187558 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.187634 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.187823 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.187920 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 06:17:52.188489 5245 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:17:52.188891 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.188773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:45982)
0812 06:17:52.188827 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.188857 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 06:17:52.189464 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.189213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:45994)
0812 06:17:52.189350 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.189419 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260812 06:17:52.189709 5245 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:36783: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
I20260812 06:17:52.219699 5363 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } attempt: 1
I20260812 06:17:52.220513 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.220291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:46002)
0812 06:17:52.220387 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.220463 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 06:17:52.220858 5245 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } attempt: 1
I20260812 06:17:52.221239 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.221059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:46006)
0812 06:17:52.221149 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.221190 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260812 06:17:52.221354 5363 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:36783: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
I20260812 06:17:52.221421 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.221224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:46012)
0812 06:17:52.221319 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.221378 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 06:17:52.221985 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.221782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:46014)
0812 06:17:52.221847 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.221897 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 06:17:52.222084 5245 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:36783: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
W20260812 06:17:52.279523 5378 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:17:52.279779 5378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:52.279798 5378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:52.279822 5378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:52.281193 5378 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:52.281255 5378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:52.281270 5378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:52.281283 5378 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:52.281297 5378 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:52.283051 5378 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:33373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:41089,127.0.176.253:33145,127.0.176.252:36783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/krb5kdc/kudu_127.0.176.252.keytab
--principal=kudu/127.0.176.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.252:36783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.176.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:52.283363 5378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:52.283656 5378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:52.288997 5393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:52.289058 5390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:52.289151 5388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:52.289502 5378 server_base.cc:1034] running on GCE node
I20260812 06:17:52.289522 5363 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } attempt: 2
I20260812 06:17:52.289825 5378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:52.290033 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.289913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:46024)
0812 06:17:52.289963 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.289994 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 06:17:52.290207 5378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:52.290357 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.290260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:46028)
0812 06:17:52.290305 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.290333 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 06:17:52.290486 5363 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:36783: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
I20260812 06:17:52.291460 5378 hybrid_clock.cc:648] HybridClock initialized: now 1786515472291442 us; error 26 us; skew 500 ppm
Aug 12 06:17:52 dist-test-slave-gw5c krb5kdc[5115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515472, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:52.294458 5378 init.cc:377] Logged in from keytab as kudu/127.0.176.252@KRBTEST.COM (short username kudu)
I20260812 06:17:52.295058 5378 webserver.cc:460] Webserver started at http://127.0.176.252:39089/ using document root <none> and password file <none>
I20260812 06:17:52.295326 5378 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:52.295451 5378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:52.295617 5378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:52.296775 5378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/data/instance:
uuid: "e8dcf73d9d2a41ed820d06acd927a9a4"
format_stamp: "Formatted at 2026-08-12 06:17:52 on dist-test-slave-gw5c"
server_key: "e8d7fed41d578d9fbabd62966c34d139"
server_key_iv: "66a5cb1ed4e5dcb5c51311842e1c1d34"
server_key_version: "encryptionkey@0"
I20260812 06:17:52.297169 5378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/wal/instance:
uuid: "e8dcf73d9d2a41ed820d06acd927a9a4"
format_stamp: "Formatted at 2026-08-12 06:17:52 on dist-test-slave-gw5c"
server_key: "e8d7fed41d578d9fbabd62966c34d139"
server_key_iv: "66a5cb1ed4e5dcb5c51311842e1c1d34"
server_key_version: "encryptionkey@0"
I20260812 06:17:52.297204 5245 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } attempt: 2
I20260812 06:17:52.297760 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.297527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:46042)
0812 06:17:52.297669 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.297719 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 06:17:52.298116 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.298019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:46056)
0812 06:17:52.298069 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.298095 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 06:17:52.298215 5245 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:36783: Network error: Client connection negotiation failed: client connection to 127.0.176.252:36783: connect: Connection refused (error 111)
I20260812 06:17:52.299091 5378 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 06:17:52.300081 5404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:52.300285 5378 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:17:52.300408 5378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/wal
uuid: "e8dcf73d9d2a41ed820d06acd927a9a4"
format_stamp: "Formatted at 2026-08-12 06:17:52 on dist-test-slave-gw5c"
server_key: "e8d7fed41d578d9fbabd62966c34d139"
server_key_iv: "66a5cb1ed4e5dcb5c51311842e1c1d34"
server_key_version: "encryptionkey@0"
I20260812 06:17:52.300493 5378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:52.309029 5378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:52.311659 5378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:52.311842 5378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:52.316210 5378 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.252:36783
I20260812 06:17:52.316251 5483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.252:36783 every 8 connection(s)
I20260812 06:17:52.316677 5378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/data/info.pb
I20260812 06:17:52.317847 5485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:52.319675 5485 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:17:52.324097 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 5378
I20260812 06:17:52.324203 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515178947866-707-0/minicluster-data/master-2/wal/instance
I20260812 06:17:52.324422 707 external_mini_cluster.cc:1428] Setting key c2fdd4fe377da7b5909748bc461efb13
Aug 12 06:17:52 dist-test-slave-gw5c krb5kdc[5115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515472, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.252@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
Aug 12 06:17:52 dist-test-slave-gw5c krb5kdc[5115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.252@KRBTEST.COM
I20260812 06:17:52.330652 5248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.320543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51506 (local address 127.0.176.254:41089)
0812 06:17:52.320643 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.320645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.320895 (+ 250us) server_negotiation.cc:407] Connection header received
0812 06:17:52.321444 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.321445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.321458 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.321523 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.322233 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.323142 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.324401 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.324713 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.324789 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.327424 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.327427 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.327427 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.327436 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.329141 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.329609 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.329610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.329610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.329673 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.329951 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.329952 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.329952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.330074 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.330154 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.330470 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.330555 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 06:17:52.330875 5488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.320521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:41089 (local address 127.0.0.1:51506)
0812 06:17:52.320754 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.320792 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:52.321332 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:52.321607 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:52.321610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:52.321914 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:52.322125 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.322129 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.323256 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.323257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.324308 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.324311 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.324846 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.324848 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.325027 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.325636 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:52.325646 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:52.327287 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:52.329247 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.329255 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.329257 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.329512 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.329746 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.329747 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.329747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.329872 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.330145 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:52.330152 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:52.330328 (+ 176us) client_negotiation.cc:769] Sending connection context
0812 06:17:52.330449 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 06:17:52.330614 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":129,"threads_started":1}
I20260812 06:17:52.331936 5485 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:17:52.334219 5492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.324882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46072 (local address 127.0.176.252:36783)
0812 06:17:52.325211 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.325215 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.325233 (+ 18us) server_negotiation.cc:407] Connection header received
0812 06:17:52.325251 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.325253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.325269 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.325361 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.326012 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.327069 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.327960 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.328290 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.328463 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.330681 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.330690 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.330690 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.330698 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.332939 (+ 2241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.333316 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.333319 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.333319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.333384 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.333612 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.333613 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.333614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.333774 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.333940 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.334013 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.334100 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":112,"threads_started":1}
Aug 12 06:17:52 dist-test-slave-gw5c krb5kdc[5115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515472, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.252@KRBTEST.COM for kudu/127.0.176.253@KRBTEST.COM
I20260812 06:17:52.339986 5488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.332249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:33145 (local address 127.0.0.1:58232)
0812 06:17:52.332307 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.332318 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:52.332363 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:52.332505 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:52.332506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:52.332655 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:52.332691 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.332692 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.333331 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.333332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.333838 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.333840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.334287 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.334288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.334350 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.334823 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:52.334832 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:52.337147 (+ 2315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:52.338923 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.338924 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.338924 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.339123 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.339341 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.339342 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.339343 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.339436 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.339713 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:52.339714 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:52.339759 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 06:17:52.339824 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 06:17:52.339914 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 06:17:52.340065 5373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.332339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58232 (local address 127.0.176.253:33145)
0812 06:17:52.332404 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.332406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.332414 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:17:52.332441 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.332442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.332452 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.332504 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.332767 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.333246 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.333932 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.334143 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.334225 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.337252 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.337254 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.337254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.337264 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.338829 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.339202 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.339203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.339203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.339269 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.339488 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.339489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.339490 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.339624 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.339701 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.339872 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.339959 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
Aug 12 06:17:52 dist-test-slave-gw5c krb5kdc[5115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:52.340525 5485 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:17:52.344417 5248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.335293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51520 (local address 127.0.176.254:41089)
0812 06:17:52.335357 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.335359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.335367 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:17:52.335417 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.335418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.335431 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.335502 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.336092 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.336980 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.337800 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.338125 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.338206 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.340821 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.340822 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.340823 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.340833 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.342503 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.343066 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.343069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.343070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.343207 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.343646 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.343648 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.343649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.343840 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.343970 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.344127 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.344227 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 06:17:52 dist-test-slave-gw5c krb5kdc[5115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515472, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.252@KRBTEST.COM for kudu/127.0.176.252@KRBTEST.COM
I20260812 06:17:52.348964 5492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.340852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46088 (local address 127.0.176.252:36783)
0812 06:17:52.340893 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.340895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.340904 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:17:52.340962 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.340963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.340975 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.341053 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.341361 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.342163 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.343101 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.343647 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.343732 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.345987 (+ 2255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.345988 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.345988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.345995 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.347559 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.348069 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.348070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.348071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.348124 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.348348 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.348349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.348349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.348454 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.348504 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.348739 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.348853 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":19}
I20260812 06:17:52.349050 5488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.340818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:46088)
0812 06:17:52.340855 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.340867 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:52.340901 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:52.341055 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:52.341056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:52.341235 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:52.341281 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.341283 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.342265 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.342266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.342954 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.342958 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.343763 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.343764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.343815 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.344331 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:52.344339 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:52.345914 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:52.347731 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.347732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.347732 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.347979 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.348193 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.348194 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.348194 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.348271 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.348522 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:52.348523 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:52.348592 (+ 69us) client_negotiation.cc:769] Sending connection context
0812 06:17:52.348683 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 06:17:52.348795 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
Aug 12 06:17:52 dist-test-slave-gw5c krb5kdc[5115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.253@KRBTEST.COM
I20260812 06:17:52.351127 5485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4: Bootstrap starting.
I20260812 06:17:52.352281 5485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:52.352636 5485 log.cc:824] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:52.353044 5373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.345186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58236 (local address 127.0.176.253:33145)
0812 06:17:52.345236 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.345238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.345247 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:17:52.345274 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.345275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.345286 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.345346 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.345884 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.346335 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.347018 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.347251 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.347332 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.350123 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.350124 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.350125 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.350133 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.351840 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.352207 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.352209 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.352209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.352272 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.352512 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.352513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.352513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.352664 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.352821 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.352894 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.352981 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:17:52.353577 5485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4: No bootstrap required, opened a new log
I20260812 06:17:52.355162 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:52.355729 5485 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } }
I20260812 06:17:52.355875 5485 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8dcf73d9d2a41ed820d06acd927a9a4, State: Initialized, Role: FOLLOWER
I20260812 06:17:52.355967 5485 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } }
I20260812 06:17:52.356316 5485 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:52.356269 5496 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } } }
I20260812 06:17:52.356396 5496 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:17:52.356277 5202 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7935772136a84ba8b546344c95d82cb4"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51520
W20260812 06:17:52.358268 5514 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:17:52.358332 5514 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:17:52.358516 5378 master_runner.cc:186] Error getting master registration for 127.0.176.254:41089: OK, instance_id { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" instance_seqno: 1786515471948619 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:17:52.361527 5378 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:17:52.381641 5363 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } attempt: 3
Aug 12 06:17:52 dist-test-slave-gw5c krb5kdc[5115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515472, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.253@KRBTEST.COM for kudu/127.0.176.252@KRBTEST.COM
I20260812 06:17:52.391758 5492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.382195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46090 (local address 127.0.176.252:36783)
0812 06:17:52.382266 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.382269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.382280 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:17:52.382323 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.382324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.382334 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.382420 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.382878 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.383768 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.385244 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.385562 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.385635 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.388276 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.388278 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.388279 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.388287 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.390133 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.390572 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.390573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.390574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.390744 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.391029 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.391030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.391030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.391260 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.391330 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.391554 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.391644 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 06:17:52.391755 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.382068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:46090)
0812 06:17:52.382135 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.382148 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:52.382191 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:52.382498 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:52.382500 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:52.382717 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:52.382781 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.382784 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.383881 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.383882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.385143 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.385147 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.385649 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.385650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.385715 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.386271 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:52.386277 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:52.388143 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:52.390239 (+ 2096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.390241 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.390241 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.390489 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.390861 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.390863 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.390863 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.390948 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.391340 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:52.391341 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:52.391435 (+ 94us) client_negotiation.cc:769] Sending connection context
0812 06:17:52.391518 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 06:17:52.391640 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 06:17:52.393951 5363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590: Bootstrap starting.
I20260812 06:17:52.394791 5363 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:52.395118 5363 log.cc:824] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:52.396137 5363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590: No bootstrap required, opened a new log
I20260812 06:17:52.397354 5245 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } attempt: 3
I20260812 06:17:52.398262 5363 raft_consensus.cc:348] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } }
I20260812 06:17:52.398429 5363 raft_consensus.cc:729] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d82f4ad59f42479da34b712944084590, State: Initialized, Role: FOLLOWER
I20260812 06:17:52.398521 5363 consensus_queue.cc:260] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } }
I20260812 06:17:52.398906 5363 sys_catalog.cc:564] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:52.398885 5517 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } } }
I20260812 06:17:52.399183 5517 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590 [sys.catalog]: This master's current role is: FOLLOWER
Aug 12 06:17:52 dist-test-slave-gw5c krb5kdc[5115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515471, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for kudu/127.0.176.252@KRBTEST.COM
W20260812 06:17:52.403484 5541 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:17:52.403565 5541 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:17:52.401486 5262 master_runner.cc:186] Error getting master registration for 127.0.176.254:41089: OK, instance_id { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" instance_seqno: 1786515471948619 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:17:52.404232 5262 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:17:52.406924 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.397760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:36783 (local address 127.0.0.1:46104)
0812 06:17:52.397824 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:52.397836 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:52.397881 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:52.398152 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:52.398153 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:52.398359 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:52.398456 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.398459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.399373 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.399374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.400586 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:52.400590 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.401137 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.401138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:52.401241 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.401807 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:52.401813 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:52.403520 (+ 1707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:52.405680 (+ 2160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.405681 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.405681 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.405929 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.406158 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:52.406158 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:52.406159 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:52.406243 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:52.406550 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:52.406551 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:52.406626 (+ 75us) client_negotiation.cc:769] Sending connection context
0812 06:17:52.406700 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:17:52.406822 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 06:17:52.406950 5492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.397969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46104 (local address 127.0.176.252:36783)
0812 06:17:52.398021 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.398022 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.398030 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:17:52.398055 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.398056 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.398072 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.398147 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.398547 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.399264 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.400736 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.401055 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.401138 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.403765 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.403767 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.403767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.403776 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.405579 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.406019 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.406020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.406020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.406087 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.406328 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.406329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.406330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.406481 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.406554 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.406742 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.406850 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:17:52.408417 5245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4: Bootstrap starting.
I20260812 06:17:52.409122 5245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:52.409459 5245 log.cc:824] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:52.410526 5245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4: No bootstrap required, opened a new log
I20260812 06:17:52.412621 5245 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } }
I20260812 06:17:52.412781 5245 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7935772136a84ba8b546344c95d82cb4, State: Initialized, Role: FOLLOWER
I20260812 06:17:52.412864 5245 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } }
I20260812 06:17:52.413203 5245 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:52.413275 5202 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:17:52.413404 5202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:52.414304 5202 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } }
I20260812 06:17:52.414583 5202 leader_election.cc:288] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [CANDIDATE]: Term 1 election: Requested vote from peers d82f4ad59f42479da34b712944084590 (127.0.176.253:33145), e8dcf73d9d2a41ed820d06acd927a9a4 (127.0.176.252:36783)
I20260812 06:17:52.415038 5326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7935772136a84ba8b546344c95d82cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d82f4ad59f42479da34b712944084590"
I20260812 06:17:52.415158 5326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:52.415230 5442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7935772136a84ba8b546344c95d82cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4"
I20260812 06:17:52.415366 5442 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:52.416354 5442 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7935772136a84ba8b546344c95d82cb4 in term 1.
I20260812 06:17:52.416642 5168 leader_election.cc:302] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7935772136a84ba8b546344c95d82cb4, e8dcf73d9d2a41ed820d06acd927a9a4; no voters:
I20260812 06:17:52.417227 5326 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7935772136a84ba8b546344c95d82cb4 in term 1.
W20260812 06:17:52.418637 5573 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:17:52.418694 5573 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:17:52.413204 5547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } } }
I20260812 06:17:52.419430 5547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:17:52.420648 5547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:52.420900 5547 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [term 1 LEADER]: Becoming Leader. State: Replica: 7935772136a84ba8b546344c95d82cb4, State: Running, Role: LEADER
I20260812 06:17:52.421161 5136 master_runner.cc:263] No leader master found from master 7935772136a84ba8b546344c95d82cb4
I20260812 06:17:52.421196 5136 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:17:52.421083 5547 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } }
I20260812 06:17:52.421813 5547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7935772136a84ba8b546344c95d82cb4. Latest consensus state: current_term: 1 leader_uuid: "7935772136a84ba8b546344c95d82cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } } }
I20260812 06:17:52.421954 5547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:52.424721 5578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:52.424950 5578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:52.431342 5248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.422348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51532 (local address 127.0.176.254:41089)
0812 06:17:52.422400 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.422403 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.422625 (+ 222us) server_negotiation.cc:407] Connection header received
0812 06:17:52.422727 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.422728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.422738 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.422767 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.423592 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.424343 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.425393 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.425682 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.425721 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.427920 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.427922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.427922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.427930 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.430058 (+ 2128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.430477 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.430479 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.430479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.430535 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.430726 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.430727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.430727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.430876 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.430952 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.431163 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.431246 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:17:52.433521 5373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.422701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58244 (local address 127.0.176.253:33145)
0812 06:17:52.422744 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.422745 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.423077 (+ 332us) server_negotiation.cc:407] Connection header received
0812 06:17:52.423169 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.423169 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.423180 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.423208 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.423942 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.424693 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.425725 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.426005 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.426047 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.427874 (+ 1827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.427875 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.427876 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.427883 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.430676 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.432359 (+ 1683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.432361 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.432362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.432439 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.432902 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.432903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.432903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.433041 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.433142 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.433329 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.433423 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:17:52.435767 5492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:52.419674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46110 (local address 127.0.176.252:36783)
0812 06:17:52.419720 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.419722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.422583 (+ 2861us) server_negotiation.cc:407] Connection header received
0812 06:17:52.422699 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.422700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.422713 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.422748 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.425713 (+ 2965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.426399 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.428827 (+ 2428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:52.429548 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:52.429598 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:52.432756 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:52.432758 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:52.432758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:52.432767 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:52.434460 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.434856 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.434857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.434858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.434927 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:52.435165 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:52.435166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:52.435166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:52.435309 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:52.435437 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:52.435589 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 06:17:52.435672 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:17:52.436555 5442 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4 [term 1 FOLLOWER]: Refusing update from remote peer 7935772136a84ba8b546344c95d82cb4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:52.436676 5326 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590 [term 1 FOLLOWER]: Refusing update from remote peer 7935772136a84ba8b546344c95d82cb4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:52.436932 5547 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:52.437106 5566 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:52.438515 5517 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7935772136a84ba8b546344c95d82cb4. Latest consensus state: current_term: 1 leader_uuid: "7935772136a84ba8b546344c95d82cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } } }
I20260812 06:17:52.438517 5496 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7935772136a84ba8b546344c95d82cb4. Latest consensus state: current_term: 1 leader_uuid: "7935772136a84ba8b546344c95d82cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } } }
I20260812 06:17:52.438609 5517 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:17:52.438609 5496 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:17:52.446394 5171 tablet.cc:2369] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:17:52.448292 5566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7935772136a84ba8b546344c95d82cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } } }
I20260812 06:17:52.448463 5566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:52.448578 5582 mvcc.cc:205] Tried to move back new op lower bound from 7317567375097683968 to 7317567375038480384. Current Snapshot: MvccSnapshot[applied={T|T < 7317567375097683968}]
I20260812 06:17:52.448637 5566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7935772136a84ba8b546344c95d82cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } } }
I20260812 06:17:52.448706 5566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:52.449198 5584 mvcc.cc:205] Tried to move back new op lower bound from 7317567375097683968 to 7317567375038480384. Current Snapshot: MvccSnapshot[applied={T|T < 7317567375097683968}]
I20260812 06:17:52.449296 5496 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7935772136a84ba8b546344c95d82cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } } }
I20260812 06:17:52.449383 5496 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:17:52.449976 5583 mvcc.cc:205] Tried to move back new op lower bound from 7317567375097683968 to 7317567375038480384. Current Snapshot: MvccSnapshot[applied={T|T < 7317567375097683968}]
I20260812 06:17:52.450090 5517 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7935772136a84ba8b546344c95d82cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7935772136a84ba8b546344c95d82cb4" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 41089 } } peers { permanent_uuid: "d82f4ad59f42479da34b712944084590" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 33145 } } peers { permanent_uuid: "e8dcf73d9d2a41ed820d06acd927a9a4" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 36783 } } }
I20260812 06:17:52.450170 5517 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:17:52.456501 5578 catalog_manager.cc:1347] Generated new cluster ID: e068319fbec64c34a89dfa97f0ae3829
I20260812 06:17:52.456590 5578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:52.480528 5578 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:52.481331 5578 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:52.492431 5578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7935772136a84ba8b546344c95d82cb4: Generated new TSK 0
I20260812 06:17:52.492708 5578 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:17:52.525858 5492 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:52.523349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46126 (local address 127.0.176.252:36783)
0812 06:17:52.523427 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.523429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.524497 (+ 1068us) server_negotiation.cc:407] Connection header received
0812 06:17:52.524719 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.524722 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.524755 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.524852 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.525774 (+ 922us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46126: BlockingRecv error: recv got EOF from 127.0.0.1:46126 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260812 06:17:52.527006 5373 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:52.523836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58250 (local address 127.0.176.253:33145)
0812 06:17:52.523889 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.523891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.526163 (+ 2272us) server_negotiation.cc:407] Connection header received
0812 06:17:52.526435 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.526437 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.526451 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.526485 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.526938 (+ 453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58250: BlockingRecv error: recv got EOF from 127.0.0.1:58250 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260812 06:17:52.528031 5248 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:52.524222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51544 (local address 127.0.176.254:41089)
0812 06:17:52.524264 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.524266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.527434 (+ 3168us) server_negotiation.cc:407] Connection header received
0812 06:17:52.527557 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.527558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.527570 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.527615 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.527965 (+ 350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51544: BlockingRecv error: recv got EOF from 127.0.0.1:51544 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 06:17:52.531111 5373 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:52.530223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58256 (local address 127.0.176.253:33145)
0812 06:17:52.530268 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.530270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.530528 (+ 258us) server_negotiation.cc:407] Connection header received
0812 06:17:52.530643 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.530645 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.530664 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.530695 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.531057 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58256: BlockingRecv error: recv got EOF from 127.0.0.1:58256 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 06:17:52.534567 5373 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:52.533691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58272 (local address 127.0.176.253:33145)
0812 06:17:52.533729 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.533730 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.534013 (+ 283us) server_negotiation.cc:407] Connection header received
0812 06:17:52.534117 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.534118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.534129 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.534159 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.534517 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58272: BlockingRecv error: recv got EOF from 127.0.0.1:58272 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 06:17:52.538724 5373 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:52.537805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58280 (local address 127.0.176.253:33145)
0812 06:17:52.537847 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.537849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.538139 (+ 290us) server_negotiation.cc:407] Connection header received
0812 06:17:52.538241 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.538242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.538254 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.538283 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.538669 (+ 386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58280: BlockingRecv error: recv got EOF from 127.0.0.1:58280 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 06:17:52.545262 5373 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:52.544237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58286 (local address 127.0.176.253:33145)
0812 06:17:52.544286 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.544288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.544598 (+ 310us) server_negotiation.cc:407] Connection header received
0812 06:17:52.544717 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.544718 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.544731 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.544762 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.545201 (+ 439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58286: BlockingRecv error: recv got EOF from 127.0.0.1:58286 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 06:17:52.555708 5373 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:52.554827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58292 (local address 127.0.176.253:33145)
0812 06:17:52.554883 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.554885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.555015 (+ 130us) server_negotiation.cc:407] Connection header received
0812 06:17:52.555073 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.555074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.555086 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.555166 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.555644 (+ 478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58292: BlockingRecv error: recv got EOF from 127.0.0.1:58292 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260812 06:17:52.573906 5373 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:52.573059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58300 (local address 127.0.176.253:33145)
0812 06:17:52.573108 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.573110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.573246 (+ 136us) server_negotiation.cc:407] Connection header received
0812 06:17:52.573286 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.573287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.573300 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.573391 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.573840 (+ 449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58300: BlockingRecv error: recv got EOF from 127.0.0.1:58300 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 06:17:52.608345 5373 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:52.607187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58314 (local address 127.0.176.253:33145)
0812 06:17:52.607282 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.607287 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.607469 (+ 182us) server_negotiation.cc:407] Connection header received
0812 06:17:52.607519 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.607520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.607533 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.607701 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.608241 (+ 540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58314: BlockingRecv error: recv got EOF from 127.0.0.1:58314 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260812 06:17:52.674480 5373 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:52.673772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58322 (local address 127.0.176.253:33145)
0812 06:17:52.673880 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.673884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.673896 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:17:52.673959 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.673960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.673978 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.674043 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.674429 (+ 386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58322: BlockingRecv error: recv got EOF from 127.0.0.1:58322 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260812 06:17:52.805150 5373 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:52.804206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58336 (local address 127.0.176.253:33145)
0812 06:17:52.804293 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:52.804295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:52.804368 (+ 73us) server_negotiation.cc:407] Connection header received
0812 06:17:52.804399 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:52.804400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:52.804420 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:52.804467 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:52.804973 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58336: BlockingRecv error: recv got EOF from 127.0.0.1:58336 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260812 06:17:53.063892 5373 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:53.063041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58348 (local address 127.0.176.253:33145)
0812 06:17:53.063114 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:53.063116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:53.063128 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:17:53.063183 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:53.063185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:53.063204 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:53.063278 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:53.063811 (+ 533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58348: BlockingRecv error: recv got EOF from 127.0.0.1:58348 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 06:17:53.358862 5514 catalog_manager.cc:1259] Loaded cluster ID: e068319fbec64c34a89dfa97f0ae3829
I20260812 06:17:53.359015 5514 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4: loading cluster ID for follower catalog manager: success
I20260812 06:17:53.359889 5514 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4: acquiring CA information for follower catalog manager: success
I20260812 06:17:53.360224 5514 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e8dcf73d9d2a41ed820d06acd927a9a4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:17:53.404142 5541 catalog_manager.cc:1259] Loaded cluster ID: e068319fbec64c34a89dfa97f0ae3829
I20260812 06:17:53.404258 5541 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590: loading cluster ID for follower catalog manager: success
I20260812 06:17:53.405354 5541 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590: acquiring CA information for follower catalog manager: success
I20260812 06:17:53.405746 5541 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d82f4ad59f42479da34b712944084590: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:17:53.580061 5703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:53.577369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58360 (local address 127.0.176.253:33145)
0812 06:17:53.577534 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:53.577536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:53.577547 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:17:53.577574 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:53.577575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:53.577632 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:53.577710 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:53.577872 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:53.578376 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:53.579189 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:53.579384 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:53.579526 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:53.579731 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:53.579852 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:53.579928 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:53.579967 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 06:17:53.579989 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260812 06:17:53.584686 5711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:53.582021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46132 (local address 127.0.176.252:36783)
0812 06:17:53.582170 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:53.582172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:53.582181 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:17:53.582231 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:53.582232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:53.582275 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:53.582369 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:53.582498 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:53.583001 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:53.583843 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:53.584059 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:53.584138 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:53.584302 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:53.584425 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:53.584517 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:53.584558 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 06:17:53.584582 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":70,"threads_started":1}
I20260812 06:17:53.589913 5722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:53.586640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51546 (local address 127.0.176.254:41089)
0812 06:17:53.586780 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:53.586782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:53.586899 (+ 117us) server_negotiation.cc:407] Connection header received
0812 06:17:53.586980 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:53.586981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:53.587037 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:53.587116 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:53.587344 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:53.588108 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:53.588872 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:53.589165 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:53.589232 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:53.589439 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:53.589555 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:53.589621 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:53.589664 (+ 43us) server_negotiation.cc:299] Negotiation successful
0812 06:17:53.589687 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260812 06:17:53.590378 5703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:53.586647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58376 (local address 127.0.176.253:33145)
0812 06:17:53.586723 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:53.586725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:53.586923 (+ 198us) server_negotiation.cc:407] Connection header received
0812 06:17:53.587028 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:53.587029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:53.587039 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:53.587096 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:53.587240 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:53.588033 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:53.589017 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:53.589256 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:53.589316 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:53.589524 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:53.589556 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:53.589615 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:53.589790 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 06:17:53.589815 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:17:53.590847 5711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:53.586701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46148 (local address 127.0.176.252:36783)
0812 06:17:53.586740 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:53.586742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:53.587019 (+ 277us) server_negotiation.cc:407] Connection header received
0812 06:17:53.587044 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:53.587045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:53.587064 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:53.587130 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:53.587280 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:53.587848 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:53.588949 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:53.589245 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:53.589302 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:53.589470 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:53.589510 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:53.589561 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:53.590449 (+ 888us) server_negotiation.cc:299] Negotiation successful
0812 06:17:53.590765 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:17:53.592330 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 5136
I20260812 06:17:53.604821 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 5262
I20260812 06:17:53.618441 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 5378
2026-08-12T06:17:53Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3273 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:17:53 dist-test-slave-gw5c krb5kdc[5729](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:17:53 dist-test-slave-gw5c krb5kdc[5729](info): set up 2 sockets
Aug 12 06:17:53 dist-test-slave-gw5c krb5kdc[5729](info): commencing operation
krb5kdc: starting...
W20260812 06:17:54.964434 707 mini_kdc.cc:121] Time spent starting KDC: real 1.309s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/test-user.keytab.
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:17:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:17:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.176.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
Entry for principal kudu/127.0.176.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab.
I20260812 06:17:55.102319 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:38969
--webserver_interface=127.0.176.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:35749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:38969,127.0.176.253:35623,127.0.176.252:39979
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:17:55.191586 5751 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:17:55.191886 5751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:55.191922 5751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:55.191968 5751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:55.193205 5751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:55.193292 5751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:55.193318 5751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:55.193341 5751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:55.193372 5751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:55.195012 5751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:35749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:38969,127.0.176.253:35623,127.0.176.252:39979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kudu_127.0.176.254.keytab
--principal=kudu/127.0.176.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.254:38969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.176.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:55.195328 5751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:55.195626 5751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:55.200850 5764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:55.200856 5760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:55.200856 5759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:55.201174 5751 server_base.cc:1034] running on GCE node
I20260812 06:17:55.201439 5751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:55.201798 5751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:55.202977 5751 hybrid_clock.cc:648] HybridClock initialized: now 1786515475202963 us; error 48 us; skew 500 ppm
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:55.206085 5751 init.cc:377] Logged in from keytab as kudu/127.0.176.254@KRBTEST.COM (short username kudu)
I20260812 06:17:55.206684 5751 webserver.cc:460] Webserver started at http://127.0.176.254:40133/ using document root <none> and password file <none>
I20260812 06:17:55.206930 5751 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:55.207007 5751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:55.207172 5751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:55.208374 5751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/data/instance:
uuid: "943e8fa5b6df4fff8314c325eaf32f6c"
format_stamp: "Formatted at 2026-08-12 06:17:55 on dist-test-slave-gw5c"
server_key: "640c29ce5653d70d0e5da952fe89c910"
server_key_iv: "00d19d3ce0e1368b613e9f5918995b2b"
server_key_version: "encryptionkey@0"
I20260812 06:17:55.208791 5751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/wal/instance:
uuid: "943e8fa5b6df4fff8314c325eaf32f6c"
format_stamp: "Formatted at 2026-08-12 06:17:55 on dist-test-slave-gw5c"
server_key: "640c29ce5653d70d0e5da952fe89c910"
server_key_iv: "00d19d3ce0e1368b613e9f5918995b2b"
server_key_version: "encryptionkey@0"
I20260812 06:17:55.210660 5751 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 06:17:55.212186 5773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:55.212972 5751 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:17:55.213092 5751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/wal
uuid: "943e8fa5b6df4fff8314c325eaf32f6c"
format_stamp: "Formatted at 2026-08-12 06:17:55 on dist-test-slave-gw5c"
server_key: "640c29ce5653d70d0e5da952fe89c910"
server_key_iv: "00d19d3ce0e1368b613e9f5918995b2b"
server_key_version: "encryptionkey@0"
I20260812 06:17:55.213186 5751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:55.232493 5751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:55.234843 5751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:55.235036 5751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:55.240525 5751 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.254:38969
I20260812 06:17:55.240581 5856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.254:38969 every 8 connection(s)
I20260812 06:17:55.240993 5751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/data/info.pb
I20260812 06:17:55.242120 5857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:55.243990 5857 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:17:55.249408 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 5751
I20260812 06:17:55.249537 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-0/wal/instance
I20260812 06:17:55.249782 707 external_mini_cluster.cc:1428] Setting key 4e2603e47c79fd2724778378d4a3e33a
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:55.256614 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.244780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:38969 (local address 127.0.0.1:56184)
0812 06:17:55.245093 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.245143 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:55.245860 (+ 717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:55.246192 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:55.246195 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:55.246514 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:55.246681 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.246685 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.247830 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.247832 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.248527 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.248529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.249083 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.249085 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.249149 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.249907 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:55.249916 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:55.252246 (+ 2330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:55.254731 (+ 2485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.254740 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.254743 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.255126 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.255456 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.255457 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.255458 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.255550 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.255949 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:55.255955 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:55.256033 (+ 78us) client_negotiation.cc:769] Sending connection context
0812 06:17:55.256145 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 06:17:55.256403 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":95,"thread_start_us":133,"threads_started":1}
I20260812 06:17:55.256613 5863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.244888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56184 (local address 127.0.176.254:38969)
0812 06:17:55.245106 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.245117 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.245229 (+ 112us) server_negotiation.cc:407] Connection header received
0812 06:17:55.246055 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.246062 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.246082 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.246187 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.246801 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.247736 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.248637 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.248960 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.249101 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.252373 (+ 3272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.252385 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.252386 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.252395 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.254531 (+ 2136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.255222 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.255225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.255225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.255318 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.255624 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.255625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.255625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.255873 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.255982 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.256181 (+ 199us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.256331 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":81,"threads_started":1}
I20260812 06:17:55.257587 5857 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:17:55.258018 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.257891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:35623 (local address 127.0.0.1:54974)
0812 06:17:55.257942 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.257993 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:35623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 06:17:55.258157 5775 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.176.253:35623: connect: Connection refused (error 111)
I20260812 06:17:55.258692 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.258590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:35623 (local address 127.0.0.1:54978)
0812 06:17:55.258635 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.258661 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:35623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 06:17:55.258796 5857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.253:35623: Network error: Client connection negotiation failed: client connection to 127.0.176.253:35623: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.0.176.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kudu_127.0.176.253.keytab.
Entry for principal kudu/127.0.176.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kudu_127.0.176.253.keytab.
I20260812 06:17:55.282004 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.253:35623
--webserver_interface=127.0.176.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kudu_127.0.176.253.keytab
--principal=kudu/127.0.176.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:35749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:38969,127.0.176.253:35623,127.0.176.252:39979
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:17:55.308051 5857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } attempt: 1
I20260812 06:17:55.308630 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.308445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:35623 (local address 127.0.0.1:54986)
0812 06:17:55.308531 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.308586 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:35623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 06:17:55.309033 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.308934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:35623 (local address 127.0.0.1:54992)
0812 06:17:55.308983 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.309013 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:35623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 06:17:55.309235 5857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.253:35623: Network error: Client connection negotiation failed: client connection to 127.0.176.253:35623: connect: Connection refused (error 111)
I20260812 06:17:55.377425 5857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } attempt: 2
I20260812 06:17:55.377977 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.377836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:35623 (local address 127.0.0.1:54996)
0812 06:17:55.377901 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.377937 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:35623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 06:17:55.378398 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.378292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:35623 (local address 127.0.0.1:54998)
0812 06:17:55.378350 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.378375 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.253:35623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 06:17:55.378655 5857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.253:35623: Network error: Client connection negotiation failed: client connection to 127.0.176.253:35623: connect: Connection refused (error 111)
W20260812 06:17:55.382982 5871 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:17:55.383229 5871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:55.383248 5871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:55.383272 5871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:55.384611 5871 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:55.384667 5871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:55.384682 5871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:55.384696 5871 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:55.384708 5871 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:55.386401 5871 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:35749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:38969,127.0.176.253:35623,127.0.176.252:39979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kudu_127.0.176.253.keytab
--principal=kudu/127.0.176.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.253:35623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.176.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:55.386641 5871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:55.386844 5871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:55.392040 5884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:55.392093 5878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:55.392047 5881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:55.392493 5871 server_base.cc:1034] running on GCE node
I20260812 06:17:55.392779 5871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:55.393095 5871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:55.394342 5871 hybrid_clock.cc:648] HybridClock initialized: now 1786515475394325 us; error 40 us; skew 500 ppm
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:55.397686 5871 init.cc:377] Logged in from keytab as kudu/127.0.176.253@KRBTEST.COM (short username kudu)
I20260812 06:17:55.398332 5871 webserver.cc:460] Webserver started at http://127.0.176.253:43333/ using document root <none> and password file <none>
I20260812 06:17:55.398612 5871 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:55.398698 5871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:55.398864 5871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:55.400200 5871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/data/instance:
uuid: "2cb623010a89457b8bc9053a454983f6"
format_stamp: "Formatted at 2026-08-12 06:17:55 on dist-test-slave-gw5c"
server_key: "4c9a94f1a2f228f94b934572af0523ad"
server_key_iv: "d8e4b6585606dc6a1dc117dca6a70575"
server_key_version: "encryptionkey@0"
I20260812 06:17:55.400633 5871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/wal/instance:
uuid: "2cb623010a89457b8bc9053a454983f6"
format_stamp: "Formatted at 2026-08-12 06:17:55 on dist-test-slave-gw5c"
server_key: "4c9a94f1a2f228f94b934572af0523ad"
server_key_iv: "d8e4b6585606dc6a1dc117dca6a70575"
server_key_version: "encryptionkey@0"
I20260812 06:17:55.402248 5871 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:17:55.403241 5896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:55.403517 5871 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:55.403649 5871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/wal
uuid: "2cb623010a89457b8bc9053a454983f6"
format_stamp: "Formatted at 2026-08-12 06:17:55 on dist-test-slave-gw5c"
server_key: "4c9a94f1a2f228f94b934572af0523ad"
server_key_iv: "d8e4b6585606dc6a1dc117dca6a70575"
server_key_version: "encryptionkey@0"
I20260812 06:17:55.403749 5871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:55.419824 5871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:55.422220 5871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:55.422411 5871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:55.427269 5871 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.253:35623
I20260812 06:17:55.427316 5990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.253:35623 every 8 connection(s)
I20260812 06:17:55.427795 5871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/data/info.pb
I20260812 06:17:55.428990 5991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:55.430521 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 5871
I20260812 06:17:55.430693 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-1/wal/instance
I20260812 06:17:55.430948 707 external_mini_cluster.cc:1428] Setting key 66b0bedb88d802d361b96f58852f0987
I20260812 06:17:55.431524 5991 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.253@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.0.176.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.176.252@KRBTEST.COM" created.
I20260812 06:17:55.447484 5863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.432904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56192 (local address 127.0.176.254:38969)
0812 06:17:55.433083 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.433087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.433504 (+ 417us) server_negotiation.cc:407] Connection header received
0812 06:17:55.434383 (+ 879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.434385 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.434405 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.434527 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.435559 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.436324 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.438249 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.438677 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.438798 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.441749 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.441751 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.441751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.441759 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.444754 (+ 2995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.445561 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.445563 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.445563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.445808 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.446260 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.446261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.446262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.446512 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.446608 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.447122 (+ 514us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.447272 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260812 06:17:55.447963 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.432838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:38969 (local address 127.0.0.1:56192)
0812 06:17:55.433262 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.433333 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:55.434222 (+ 889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:55.434726 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:55.434732 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:55.435095 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:55.435344 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.435349 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.436525 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.436527 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.438098 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.438104 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.438902 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.438905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.439141 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.439856 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:55.439866 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:55.441617 (+ 1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:55.444907 (+ 3290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.444928 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.444932 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.445421 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.445910 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.445912 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.445912 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.446153 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.446630 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:55.446640 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:55.446847 (+ 207us) client_negotiation.cc:769] Sending connection context
0812 06:17:55.447090 (+ 243us) client_negotiation.cc:240] Negotiation successful
0812 06:17:55.447360 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":263,"threads_started":1}
I20260812 06:17:55.448890 5991 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.253@KRBTEST.COM for kudu/127.0.176.253@KRBTEST.COM
I20260812 06:17:55.457581 5998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.449407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55012 (local address 127.0.176.253:35623)
0812 06:17:55.449836 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.449841 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.449862 (+ 21us) server_negotiation.cc:407] Connection header received
0812 06:17:55.449883 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.449885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.449898 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.450029 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.450362 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.451096 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.451935 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.452276 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.452374 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.454356 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.454385 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.454386 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.454392 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.456105 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.456503 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.456506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.456506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.456569 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.456770 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.456771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.456771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.457007 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.457100 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.457306 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.457447 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":395,"thread_start_us":145,"threads_started":1}
I20260812 06:17:55.457733 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.449285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:35623 (local address 127.0.0.1:55012)
0812 06:17:55.449345 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.449356 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:55.449411 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:55.450031 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:55.450032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:55.450208 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:55.450271 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.450273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.451194 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.451195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.451812 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.451815 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.452373 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.452373 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.452445 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.452943 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:55.452954 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:55.454251 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:55.456220 (+ 1969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.456221 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.456222 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.456405 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.456639 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.456640 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.456641 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.456704 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.457083 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:55.457084 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:55.457140 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 06:17:55.457265 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 06:17:55.457552 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":150}
I20260812 06:17:55.458501 5991 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:17:55.458986 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.458835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42240)
0812 06:17:55.458891 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.458946 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 06:17:55.459159 5897 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
I20260812 06:17:55.459734 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.459616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42252)
0812 06:17:55.459679 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.459708 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 06:17:55.459849 5991 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:39979: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.176.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kudu_127.0.176.252.keytab.
Entry for principal kudu/127.0.176.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kudu_127.0.176.252.keytab.
I20260812 06:17:55.466526 707 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuoICiU/build/release/bin/kudu
/tmp/dist-test-taskuoICiU/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.252:39979
--webserver_interface=127.0.176.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kudu_127.0.176.252.keytab
--principal=kudu/127.0.176.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.176.212:35749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.176.254:38969,127.0.176.253:35623,127.0.176.252:39979
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:17:55.469918 5857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } attempt: 3
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for kudu/127.0.176.253@KRBTEST.COM
I20260812 06:17:55.479359 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.470712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:35623 (local address 127.0.0.1:55026)
0812 06:17:55.470984 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.471000 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:55.471127 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:55.471318 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:55.471319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:55.471615 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:55.471691 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.471693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.472447 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.472449 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.473403 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.473406 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.473999 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.474001 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.474107 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.474650 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:55.474656 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:55.476347 (+ 1691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:55.478190 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.478192 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.478192 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.478397 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.478616 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.478617 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.478617 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.478686 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.478978 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:55.478979 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:55.479035 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 06:17:55.479127 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 06:17:55.479248 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239}
I20260812 06:17:55.479357 5998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.470894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55026 (local address 127.0.176.253:35623)
0812 06:17:55.470971 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.470974 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.471099 (+ 125us) server_negotiation.cc:407] Connection header received
0812 06:17:55.471210 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.471211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.471232 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.471299 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.471785 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.472306 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.473541 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.473895 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.473965 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.476477 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.476482 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.476482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.476495 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.478063 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.478477 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.478478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.478479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.478544 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.478753 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.478754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.478754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.478892 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.478988 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.479153 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.479250 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 06:17:55.479841 5857 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:17:55.480268 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.480155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42256)
0812 06:17:55.480208 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.480239 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 06:17:55.480643 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.480555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42260)
0812 06:17:55.480598 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.480622 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 06:17:55.480739 5857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:39979: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
I20260812 06:17:55.509094 5991 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } attempt: 1
I20260812 06:17:55.509761 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.509581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42262)
0812 06:17:55.509661 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.509719 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 06:17:55.510182 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.510073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42276)
0812 06:17:55.510123 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.510155 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 06:17:55.510352 5991 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:39979: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
I20260812 06:17:55.511900 5857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } attempt: 1
I20260812 06:17:55.512349 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.512221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42290)
0812 06:17:55.512284 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.512323 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 06:17:55.512847 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.512707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42306)
0812 06:17:55.512784 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.512825 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 06:17:55.512993 5857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:39979: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
W20260812 06:17:55.563525 6000 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:17:55.563805 6000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:17:55.563825 6000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:17:55.563851 6000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:17:55.565347 6000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:17:55.565420 6000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:17:55.565436 6000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:17:55.565459 6000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:17:55.565474 6000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:17:55.567232 6000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.176.212:35749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.0.176.254:38969,127.0.176.253:35623,127.0.176.252:39979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/krb5kdc/kudu_127.0.176.252.keytab
--principal=kudu/127.0.176.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.176.252:39979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.176.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:17:55.567595 6000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:17:55.567903 6000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:17:55.576675 6010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:55.576790 6000 server_base.cc:1034] running on GCE node
W20260812 06:17:55.576685 6009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:17:55.576678 6013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:17:55.577303 6000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:17:55.577651 6000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:17:55.578508 5991 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } attempt: 2
I20260812 06:17:55.578830 6000 hybrid_clock.cc:648] HybridClock initialized: now 1786515475578803 us; error 44 us; skew 500 ppm
I20260812 06:17:55.578990 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.578835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42314)
0812 06:17:55.578904 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.578938 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 06:17:55.579329 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.579227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42330)
0812 06:17:55.579275 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.579300 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 06:17:55.579449 5991 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:39979: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:17:55.581686 6000 init.cc:377] Logged in from keytab as kudu/127.0.176.252@KRBTEST.COM (short username kudu)
I20260812 06:17:55.582187 6000 webserver.cc:460] Webserver started at http://127.0.176.252:44613/ using document root <none> and password file <none>
I20260812 06:17:55.582434 6000 fs_manager.cc:359] Metadata directory not provided
I20260812 06:17:55.582511 6000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:17:55.582665 6000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:17:55.583897 6000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/data/instance:
uuid: "f1d2d240f7914feb825deecae43f3f5e"
format_stamp: "Formatted at 2026-08-12 06:17:55 on dist-test-slave-gw5c"
server_key: "1fa3d157b6d6885438ac2af0f92e384d"
server_key_iv: "d3cb7b43e97713522ae5363dd0a2ddb7"
server_key_version: "encryptionkey@0"
I20260812 06:17:55.584282 6000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/wal/instance:
uuid: "f1d2d240f7914feb825deecae43f3f5e"
format_stamp: "Formatted at 2026-08-12 06:17:55 on dist-test-slave-gw5c"
server_key: "1fa3d157b6d6885438ac2af0f92e384d"
server_key_iv: "d3cb7b43e97713522ae5363dd0a2ddb7"
server_key_version: "encryptionkey@0"
I20260812 06:17:55.585798 6000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:17:55.586846 6023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:17:55.587261 6000 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:17:55.587491 6000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/data,/tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/wal
uuid: "f1d2d240f7914feb825deecae43f3f5e"
format_stamp: "Formatted at 2026-08-12 06:17:55 on dist-test-slave-gw5c"
server_key: "1fa3d157b6d6885438ac2af0f92e384d"
server_key_iv: "d3cb7b43e97713522ae5363dd0a2ddb7"
server_key_version: "encryptionkey@0"
I20260812 06:17:55.587625 6000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:17:55.588176 5857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } attempt: 2
I20260812 06:17:55.588709 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.588557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42336)
0812 06:17:55.588636 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.588678 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 06:17:55.589080 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.588976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42348)
0812 06:17:55.589030 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.589062 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 06:17:55.589169 5857 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.176.252:39979: Network error: Client connection negotiation failed: client connection to 127.0.176.252:39979: connect: Connection refused (error 111)
I20260812 06:17:55.605966 6000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:17:55.609655 6000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:17:55.609838 6000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:17:55.614784 6000 rpc_server.cc:307] RPC server started. Bound to: 127.0.176.252:39979
I20260812 06:17:55.614842 6115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.176.252:39979 every 8 connection(s)
I20260812 06:17:55.615309 6000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/data/info.pb
I20260812 06:17:55.616533 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:17:55.618464 6117 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.252@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
I20260812 06:17:55.625582 707 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuoICiU/build/release/bin/kudu as pid 6000
I20260812 06:17:55.625686 707 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuoICiU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515178947866-707-0/minicluster-data/master-2/wal/instance
I20260812 06:17:55.625957 707 external_mini_cluster.cc:1428] Setting key 3589fb7d9cfca27e128600dad3041267
I20260812 06:17:55.629037 5863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.619501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56202 (local address 127.0.176.254:38969)
0812 06:17:55.619571 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.619574 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.619876 (+ 302us) server_negotiation.cc:407] Connection header received
0812 06:17:55.620472 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.620474 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.620487 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.620554 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.621277 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.621775 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.622836 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.623037 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.623132 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.625808 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.625810 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.625811 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.625821 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.627539 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.628012 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.628012 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.628013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.628067 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.628338 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.628338 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.628339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.628456 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.628511 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.628846 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.628936 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:17:55.629163 6120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.619490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.254:38969 (local address 127.0.0.1:56202)
0812 06:17:55.619737 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.619778 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:55.620340 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:55.620644 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:55.620648 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:55.620957 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:55.621176 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.621180 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.621888 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.621892 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.622732 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.622735 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.623175 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.623177 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.623315 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.623939 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:55.623949 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:55.625611 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:55.627610 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.627616 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.627618 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.627937 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.628131 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.628133 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.628133 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.628268 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.628519 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:55.628525 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:55.628687 (+ 162us) client_negotiation.cc:769] Sending connection context
0812 06:17:55.628802 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 06:17:55.628949 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":143,"threads_started":1}
I20260812 06:17:55.629783 6117 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.252@KRBTEST.COM
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.252@KRBTEST.COM for kudu/127.0.176.253@KRBTEST.COM
I20260812 06:17:55.636389 6123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.626410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42350 (local address 127.0.176.252:39979)
0812 06:17:55.626648 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.626654 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.626676 (+ 22us) server_negotiation.cc:407] Connection header received
0812 06:17:55.626739 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.626742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.626757 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.626851 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.627563 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.628651 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.629672 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.630071 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.630151 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.632706 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.632717 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.632717 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.632724 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.634706 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.635196 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.635200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.635201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.635284 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.635572 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.635573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.635573 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.635829 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.636011 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.636112 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.636223 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":115,"threads_started":1}
I20260812 06:17:55.637743 6120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.630121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.253:35623 (local address 127.0.0.1:55036)
0812 06:17:55.630160 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.630173 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:55.630207 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:55.630333 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:55.630334 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:55.630480 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:55.630530 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.630531 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.631161 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.631162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.631742 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.631744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.632135 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.632136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.632214 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.632645 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:55.632650 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:55.634026 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:55.636034 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.636035 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.636036 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.636301 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.636578 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.636579 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.636580 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.636645 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.637371 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:55.637372 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:55.637439 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 06:17:55.637508 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:17:55.637629 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 06:17:55.638083 5998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.630185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55036 (local address 127.0.176.253:35623)
0812 06:17:55.630233 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.630235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.630244 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:17:55.630270 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.630271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.630282 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.630332 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.630606 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.631071 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.631826 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.632057 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.632137 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.634158 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.634160 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.634160 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.634168 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.635934 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.636386 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.636388 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.636388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.636481 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.636952 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.636953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.636953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.637116 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.637205 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.637548 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.637748 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:17:55.638821 6117 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.254@KRBTEST.COM
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.252@KRBTEST.COM for kudu/127.0.176.252@KRBTEST.COM
I20260812 06:17:55.646464 5863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.637422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56214 (local address 127.0.176.254:38969)
0812 06:17:55.637485 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.637487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.637496 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:17:55.637526 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.637527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.637540 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.637616 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.638390 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.639028 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.640048 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.640253 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.640334 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.642895 (+ 2561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.642897 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.642897 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.642904 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.644796 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.645177 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.645179 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.645179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.645245 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.645482 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.645482 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.645482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.645801 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.646171 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.646231 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.646336 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:17:55.646960 6120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.639260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42362)
0812 06:17:55.639305 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.639315 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:55.639348 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:55.639523 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:55.639523 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:55.639692 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:55.639732 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.639734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.640383 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.640384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.640869 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.640871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.641275 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.641276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.641327 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.641741 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:55.641748 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:55.643353 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:55.645226 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.645227 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.645227 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.645491 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.645914 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.645915 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.645916 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.645989 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.646430 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:55.646431 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:55.646471 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 06:17:55.646527 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 06:17:55.646801 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:17:55.647243 6123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.639322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42362 (local address 127.0.176.252:39979)
0812 06:17:55.639361 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.639363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.639370 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:17:55.639429 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.639429 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.639440 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.639515 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.639811 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.640274 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.640977 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.641183 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.641274 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.643513 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.643514 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.643515 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.643523 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.645125 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.645564 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.645565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.645565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.645769 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.646166 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.646167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.646168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.646353 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.646429 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.646785 (+ 356us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.646860 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:17:55.649019 6117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e: Bootstrap starting.
I20260812 06:17:55.650031 6117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:55.650345 6117 log.cc:824] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:55.651346 6117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e: No bootstrap required, opened a new log
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.176.253@KRBTEST.COM
I20260812 06:17:55.653056 6117 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } }
I20260812 06:17:55.653215 6117 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1d2d240f7914feb825deecae43f3f5e, State: Initialized, Role: FOLLOWER
I20260812 06:17:55.653316 6117 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } }
I20260812 06:17:55.653645 6127 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } } }
I20260812 06:17:55.653719 6117 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:55.653745 6127 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:17:55.655877 6147 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:17:55.656109 6147 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:17:55.656792 5998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.647854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55052 (local address 127.0.176.253:35623)
0812 06:17:55.647920 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.647922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.647938 (+ 16us) server_negotiation.cc:407] Connection header received
0812 06:17:55.648022 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.648023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.648036 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.648112 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.648696 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.649397 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.650460 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.650770 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.650838 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.653465 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.653466 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.653467 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.653474 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.655404 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.655932 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.655934 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.655934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.656004 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.656209 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.656210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.656211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.656353 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.656528 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.656600 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.656690 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:17:55.658910 707 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:17:55.656235 6000 master_runner.cc:186] Error getting master registration for 127.0.176.254:38969: OK, instance_id { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" instance_seqno: 1786515475238820 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:17:55.659550 6000 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:17:55.660166 5813 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "943e8fa5b6df4fff8314c325eaf32f6c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56214
I20260812 06:17:55.670658 5991 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } attempt: 3
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.253@KRBTEST.COM for kudu/127.0.176.252@KRBTEST.COM
I20260812 06:17:55.679453 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.671397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42364)
0812 06:17:55.671657 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.671688 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:55.671801 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:55.671990 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:55.671991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:55.672276 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:55.672362 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.672364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.673122 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.673124 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.673666 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.673668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.674065 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.674067 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.674121 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.674654 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:55.674659 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:55.676186 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:55.678031 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.678033 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.678033 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.678282 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.678565 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.678566 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.678566 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.678642 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.679038 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:55.679039 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:55.679096 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 06:17:55.679179 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 06:17:55.679298 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215}
I20260812 06:17:55.679466 6123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.671622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42364 (local address 127.0.176.252:39979)
0812 06:17:55.671709 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.671712 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.671788 (+ 76us) server_negotiation.cc:407] Connection header received
0812 06:17:55.671886 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.671887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.671897 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.671962 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.672462 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.672967 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.673767 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.673983 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.674070 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.676334 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.676336 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.676337 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.676344 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.677941 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.678390 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.678392 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.678393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.678468 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.678712 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.678712 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.678713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.678940 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.679028 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.679221 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.679314 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 06:17:55.681630 5991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6: Bootstrap starting.
I20260812 06:17:55.682468 5991 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:55.682790 5991 log.cc:824] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:55.683704 5991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6: No bootstrap required, opened a new log
I20260812 06:17:55.685235 5991 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } }
I20260812 06:17:55.685385 5991 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cb623010a89457b8bc9053a454983f6, State: Initialized, Role: FOLLOWER
I20260812 06:17:55.685500 5991 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } }
I20260812 06:17:55.685843 6150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } } }
I20260812 06:17:55.685932 5991 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:55.685942 6150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:17:55.688019 6163 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:17:55.688133 6163 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:17:55.688298 5857 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } attempt: 3
I20260812 06:17:55.688285 5871 master_runner.cc:186] Error getting master registration for 127.0.176.254:38969: OK, instance_id { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" instance_seqno: 1786515475238820 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:17:55.691684 5871 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 12 06:17:55 dist-test-slave-gw5c krb5kdc[5729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515475, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.176.254@KRBTEST.COM for kudu/127.0.176.252@KRBTEST.COM
I20260812 06:17:55.696557 6123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.688661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42378 (local address 127.0.176.252:39979)
0812 06:17:55.688787 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.688789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.688795 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:17:55.688853 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.688855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.688866 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.688916 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.689267 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.690016 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.691073 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.691451 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.691518 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.693748 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.693750 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.693751 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.693760 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.695307 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.695713 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.695714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.695714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.695780 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.695994 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.695995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.695995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.696122 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.696201 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.696374 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.696452 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260812 06:17:55.696557 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.688596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.176.252:39979 (local address 127.0.0.1:42378)
0812 06:17:55.688649 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 06:17:55.688661 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:17:55.688704 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:17:55.688930 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:17:55.688931 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:17:55.689118 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:17:55.689161 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.689163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.690133 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.690134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.690961 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:17:55.690964 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.691518 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.691519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:17:55.691582 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.692131 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:17:55.692137 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:17:55.693636 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:17:55.695441 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.695442 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.695443 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.695634 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.695860 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:17:55.695860 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:17:55.695861 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:17:55.695928 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:17:55.696192 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:17:55.696193 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:17:55.696248 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 06:17:55.696334 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 06:17:55.696452 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 06:17:55.698072 5857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c: Bootstrap starting.
I20260812 06:17:55.698794 5857 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c: Neither blocks nor log segments found. Creating new log.
I20260812 06:17:55.699117 5857 log.cc:824] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:17:55.699981 5857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c: No bootstrap required, opened a new log
I20260812 06:17:55.701054 5857 raft_consensus.cc:348] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } }
I20260812 06:17:55.701210 5857 raft_consensus.cc:729] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943e8fa5b6df4fff8314c325eaf32f6c, State: Initialized, Role: FOLLOWER
I20260812 06:17:55.701342 5857 consensus_queue.cc:260] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } }
I20260812 06:17:55.702112 5857 sys_catalog.cc:564] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:17:55.702138 5813 raft_consensus.cc:482] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:17:55.702241 5813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:55.704196 5813 raft_consensus.cc:504] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } }
I20260812 06:17:55.704958 5944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2cb623010a89457b8bc9053a454983f6"
I20260812 06:17:55.705098 5944 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:55.705947 6167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } } }
I20260812 06:17:55.706063 6167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:17:55.706146 5944 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 943e8fa5b6df4fff8314c325eaf32f6c in term 1.
I20260812 06:17:55.706408 5775 leader_election.cc:302] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cb623010a89457b8bc9053a454983f6, 943e8fa5b6df4fff8314c325eaf32f6c; no voters:
I20260812 06:17:55.706528 6167 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:17:55.706696 6167 raft_consensus.cc:686] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [term 1 LEADER]: Becoming Leader. State: Replica: 943e8fa5b6df4fff8314c325eaf32f6c, State: Running, Role: LEADER
I20260812 06:17:55.706796 6167 consensus_queue.cc:237] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } }
I20260812 06:17:55.707330 6167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 943e8fa5b6df4fff8314c325eaf32f6c. Latest consensus state: current_term: 1 leader_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } } }
I20260812 06:17:55.707475 6167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:55.707739 5813 leader_election.cc:288] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [CANDIDATE]: Term 1 election: Requested vote from peers 2cb623010a89457b8bc9053a454983f6 (127.0.176.253:35623), f1d2d240f7914feb825deecae43f3f5e (127.0.176.252:39979)
W20260812 06:17:55.708531 6190 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:17:55.708664 6190 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:17:55.709368 6078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f1d2d240f7914feb825deecae43f3f5e"
I20260812 06:17:55.709510 6078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:17:55.709757 5751 master_runner.cc:232] Existing masters have differing terms: 1 vs 0
I20260812 06:17:55.709837 5751 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:17:55.710433 6078 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 943e8fa5b6df4fff8314c325eaf32f6c in term 1.
I20260812 06:17:55.711993 6195 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:17:55.713212 6195 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:17:55.721446 6123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.710916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42392 (local address 127.0.176.252:39979)
0812 06:17:55.710965 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.710967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.711459 (+ 492us) server_negotiation.cc:407] Connection header received
0812 06:17:55.711578 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.711579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.711591 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.711824 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.713579 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.714270 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.715413 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.715749 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.715802 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.718183 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.718185 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.718186 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.718195 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.720104 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.720571 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.720573 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.720573 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.720636 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.720829 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.720830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.720830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.720960 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.721031 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.721248 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.721330 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:17:55.725518 6078 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e [term 1 FOLLOWER]: Refusing update from remote peer 943e8fa5b6df4fff8314c325eaf32f6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:55.725885 6167 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:55.727495 6127 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 943e8fa5b6df4fff8314c325eaf32f6c. Latest consensus state: current_term: 1 leader_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } } }
I20260812 06:17:55.727598 6127 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:17:55.728070 5944 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6 [term 1 FOLLOWER]: Refusing update from remote peer 943e8fa5b6df4fff8314c325eaf32f6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:17:55.728291 5998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.711500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55060 (local address 127.0.176.253:35623)
0812 06:17:55.711549 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.711551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.715218 (+ 3667us) server_negotiation.cc:407] Connection header received
0812 06:17:55.715332 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.715334 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.715349 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.715383 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.719364 (+ 3981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.720164 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.721930 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.722251 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.722295 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.724634 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.724636 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.724636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.724644 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.726465 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.727006 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.727008 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.727009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.727075 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.727284 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.727284 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.727285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.727500 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.727594 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.728097 (+ 503us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.728184 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:17:55.728403 6167 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:17:55.730504 6150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 943e8fa5b6df4fff8314c325eaf32f6c. Latest consensus state: current_term: 1 leader_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } } }
I20260812 06:17:55.730638 6150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:17:55.734179 5863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:55.711188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56218 (local address 127.0.176.254:38969)
0812 06:17:55.711250 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.711253 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.714230 (+ 2977us) server_negotiation.cc:407] Connection header received
0812 06:17:55.714347 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.714349 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.714362 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.714394 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.716259 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.716988 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.721190 (+ 4202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:55.721478 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:55.721533 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:55.730934 (+ 9401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:17:55.730936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:17:55.730937 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:17:55.730948 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:17:55.732781 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.733245 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.733246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.733247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.733309 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:17:55.733518 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:17:55.733519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:17:55.733520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:17:55.733669 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:17:55.733754 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:55.733991 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 06:17:55.734080 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260812 06:17:55.736038 5780 tablet.cc:2369] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:17:55.736516 6211 mvcc.cc:205] Tried to move back new op lower bound from 7317567388568248320 to 7317567388495888384. Current Snapshot: MvccSnapshot[applied={T|T < 7317567388568248320}]
I20260812 06:17:55.736835 6167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } } }
I20260812 06:17:55.736939 6167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:55.737043 6195 catalog_manager.cc:1347] Generated new cluster ID: 701b33dae48842acb26855adf10b4990
I20260812 06:17:55.737074 6195 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:17:55.740101 6150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } } }
I20260812 06:17:55.740223 6150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:17:55.740674 6167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } } }
I20260812 06:17:55.740801 6167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c [sys.catalog]: This master's current role is: LEADER
I20260812 06:17:55.741297 6127 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943e8fa5b6df4fff8314c325eaf32f6c" member_type: VOTER last_known_addr { host: "127.0.176.254" port: 38969 } } peers { permanent_uuid: "2cb623010a89457b8bc9053a454983f6" member_type: VOTER last_known_addr { host: "127.0.176.253" port: 35623 } } peers { permanent_uuid: "f1d2d240f7914feb825deecae43f3f5e" member_type: VOTER last_known_addr { host: "127.0.176.252" port: 39979 } } }
I20260812 06:17:55.741417 6127 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:17:55.741833 6217 mvcc.cc:205] Tried to move back new op lower bound from 7317567388568248320 to 7317567388495888384. Current Snapshot: MvccSnapshot[applied={T|T < 7317567388568248320}]
I20260812 06:17:55.747787 6214 mvcc.cc:205] Tried to move back new op lower bound from 7317567388568248320 to 7317567388495888384. Current Snapshot: MvccSnapshot[applied={T|T < 7317567388568248320}]
I20260812 06:17:55.777156 6195 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:17:55.778141 6195 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:17:55.788932 6195 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 943e8fa5b6df4fff8314c325eaf32f6c: Generated new TSK 0
I20260812 06:17:55.789206 6195 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:17:55.823045 5863 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:55.821174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56232 (local address 127.0.176.254:38969)
0812 06:17:55.821226 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.821228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.822250 (+ 1022us) server_negotiation.cc:407] Connection header received
0812 06:17:55.822363 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.822364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.822377 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.822408 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.822960 (+ 552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56232: BlockingRecv error: recv got EOF from 127.0.0.1:56232 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 06:17:55.823921 5998 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:55.821573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55064 (local address 127.0.176.253:35623)
0812 06:17:55.821620 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.821622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.823334 (+ 1712us) server_negotiation.cc:407] Connection header received
0812 06:17:55.823468 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.823470 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.823482 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.823513 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.823849 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55064: BlockingRecv error: recv got EOF from 127.0.0.1:55064 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 06:17:55.824718 6123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:55.821929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42408 (local address 127.0.176.252:39979)
0812 06:17:55.821985 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.821986 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.824191 (+ 2205us) server_negotiation.cc:407] Connection header received
0812 06:17:55.824291 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.824292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.824304 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.824334 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.824652 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42408: BlockingRecv error: recv got EOF from 127.0.0.1:42408 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260812 06:17:55.827369 5998 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:55.826527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55078 (local address 127.0.176.253:35623)
0812 06:17:55.826569 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.826571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.826787 (+ 216us) server_negotiation.cc:407] Connection header received
0812 06:17:55.826896 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.826897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.826919 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.826964 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.827313 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55078: BlockingRecv error: recv got EOF from 127.0.0.1:55078 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 06:17:55.830734 5998 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:55.829858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55082 (local address 127.0.176.253:35623)
0812 06:17:55.829898 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.829900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.830175 (+ 275us) server_negotiation.cc:407] Connection header received
0812 06:17:55.830276 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.830277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.830289 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.830318 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.830669 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55082: BlockingRecv error: recv got EOF from 127.0.0.1:55082 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 06:17:55.835318 5998 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:55.834313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55088 (local address 127.0.176.253:35623)
0812 06:17:55.834362 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.834364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.834665 (+ 301us) server_negotiation.cc:407] Connection header received
0812 06:17:55.834774 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.834775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.834787 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.834820 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.835252 (+ 432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55088: BlockingRecv error: recv got EOF from 127.0.0.1:55088 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 06:17:55.843035 5998 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:55.841510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55096 (local address 127.0.176.253:35623)
0812 06:17:55.841578 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.841581 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.842046 (+ 465us) server_negotiation.cc:407] Connection header received
0812 06:17:55.842370 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.842373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.842395 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.842433 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.842964 (+ 531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55096: BlockingRecv error: recv got EOF from 127.0.0.1:55096 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260812 06:17:55.854357 5998 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:55.853065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55110 (local address 127.0.176.253:35623)
0812 06:17:55.853122 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.853125 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.853467 (+ 342us) server_negotiation.cc:407] Connection header received
0812 06:17:55.853585 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.853587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.853707 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.853767 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.854288 (+ 521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55110: BlockingRecv error: recv got EOF from 127.0.0.1:55110 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 06:17:55.873147 5998 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:55.872099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55122 (local address 127.0.176.253:35623)
0812 06:17:55.872148 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.872151 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.872437 (+ 286us) server_negotiation.cc:407] Connection header received
0812 06:17:55.872572 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.872575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.872588 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.872622 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.873080 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55122: BlockingRecv error: recv got EOF from 127.0.0.1:55122 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 06:17:55.907565 5998 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:55.906752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55130 (local address 127.0.176.253:35623)
0812 06:17:55.906839 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.906842 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.906975 (+ 133us) server_negotiation.cc:407] Connection header received
0812 06:17:55.907014 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.907015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.907029 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.907114 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.907499 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55130: BlockingRecv error: recv got EOF from 127.0.0.1:55130 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260812 06:17:55.973814 5998 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:55.972973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55134 (local address 127.0.176.253:35623)
0812 06:17:55.973058 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:55.973061 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:55.973151 (+ 90us) server_negotiation.cc:407] Connection header received
0812 06:17:55.973275 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:55.973276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:55.973290 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:55.973369 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:55.973762 (+ 393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55134: BlockingRecv error: recv got EOF from 127.0.0.1:55134 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260812 06:17:56.104943 5998 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:56.103778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55138 (local address 127.0.176.253:35623)
0812 06:17:56.103842 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:56.103844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:56.104168 (+ 324us) server_negotiation.cc:407] Connection header received
0812 06:17:56.104227 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:56.104229 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:56.104247 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:56.104323 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:56.104891 (+ 568us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55138: BlockingRecv error: recv got EOF from 127.0.0.1:55138 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260812 06:17:56.363315 5998 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:17:56.362612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55142 (local address 127.0.176.253:35623)
0812 06:17:56.362691 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:56.362694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:56.362704 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:17:56.362741 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:56.362742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:56.362756 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:56.362833 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:17:56.363214 (+ 381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55142: BlockingRecv error: recv got EOF from 127.0.0.1:55142 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 06:17:56.656706 6147 catalog_manager.cc:1259] Loaded cluster ID: 701b33dae48842acb26855adf10b4990
I20260812 06:17:56.656802 6147 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e: loading cluster ID for follower catalog manager: success
I20260812 06:17:56.657612 6147 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e: acquiring CA information for follower catalog manager: success
I20260812 06:17:56.657889 6147 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f1d2d240f7914feb825deecae43f3f5e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:17:56.688702 6163 catalog_manager.cc:1259] Loaded cluster ID: 701b33dae48842acb26855adf10b4990
I20260812 06:17:56.688825 6163 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6: loading cluster ID for follower catalog manager: success
I20260812 06:17:56.689657 6163 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6: acquiring CA information for follower catalog manager: success
I20260812 06:17:56.689980 6163 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2cb623010a89457b8bc9053a454983f6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:17:56.879575 6336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:56.876820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55150 (local address 127.0.176.253:35623)
0812 06:17:56.876962 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:56.876964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:56.876973 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:17:56.877010 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:56.877010 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:56.877079 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:56.877175 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:56.877360 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:56.877871 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:56.878656 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:56.878870 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:56.878949 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:56.879145 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:56.879278 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:56.879372 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:56.879440 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 06:17:56.879465 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":64,"threads_started":1}
I20260812 06:17:56.884174 6348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:56.881502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42422 (local address 127.0.176.252:39979)
0812 06:17:56.881639 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:56.881641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:56.881651 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:17:56.881733 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:56.881734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:56.881792 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:56.881892 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:56.882028 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:56.882530 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:56.883281 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:56.883534 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:56.883618 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:56.883797 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:56.883925 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:56.884021 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:56.884044 (+ 23us) server_negotiation.cc:299] Negotiation successful
0812 06:17:56.884070 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":65,"threads_started":1}
I20260812 06:17:56.889207 6348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:56.886272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42428 (local address 127.0.176.252:39979)
0812 06:17:56.886317 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:56.886320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:56.886432 (+ 112us) server_negotiation.cc:407] Connection header received
0812 06:17:56.886495 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:56.886496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:56.886510 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:56.886568 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:56.886819 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:56.887661 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:56.888551 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:56.888805 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:56.888878 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:56.888970 (+ 92us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:56.889002 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:56.889053 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:56.889087 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 06:17:56.889109 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:17:56.890117 6336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:56.886639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55162 (local address 127.0.176.253:35623)
0812 06:17:56.886702 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:56.886704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:56.886712 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:17:56.886739 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:56.886740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:56.886752 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:56.886814 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:56.886980 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:56.887578 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:56.888804 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:56.889117 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:56.889179 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:56.889825 (+ 646us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:56.889862 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:56.889941 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:56.889995 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 06:17:56.890022 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:17:56.890162 6358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:17:56.886176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56244 (local address 127.0.176.254:38969)
0812 06:17:56.886366 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 06:17:56.886368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:17:56.886504 (+ 136us) server_negotiation.cc:407] Connection header received
0812 06:17:56.886560 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:17:56.886561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:17:56.886624 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:17:56.886716 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:17:56.886896 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:56.887739 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:56.889221 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:17:56.889513 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:17:56.889591 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:17:56.889800 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:17:56.889907 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:17:56.889989 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:17:56.890045 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 06:17:56.890071 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":97,"threads_started":1}
I20260812 06:17:56.892160 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 5751
I20260812 06:17:56.911142 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 5871
I20260812 06:17:56.924412 707 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuoICiU/build/release/bin/kudu with pid 6000
2026-08-12T06:17:56Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3308 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6582 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (298001 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST